[ 540.285814] env[65072]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 540.285814] env[65072]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 541.332510] env[65162]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 541.332510] env[65162]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 542.896469] env[65162]: INFO neutron.common.config [-] Logging enabled! [ 542.896836] env[65162]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev54 [ 542.897019] env[65162]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65162) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 542.897333] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 542.897431] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 542.898295] env[65162]: WARNING oslo_policy.policy [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 542.898522] env[65162]: WARNING oslo_policy.policy [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 542.900300] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] VMware NSXv3 Agent initialized successfully. [ 542.900676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] Acquiring lock "singleton_lock" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.900805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] Acquired lock "singleton_lock" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.901034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] Releasing lock "singleton_lock" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.901300] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] Full set of CONF: {{(pid=65162) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 542.901407] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ******************************************************************************** {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 542.901507] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] Configuration options gathered from: {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 542.901856] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 542.902062] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 542.902200] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ================================================================================ {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 542.902319] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] agent_down_time = 75 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.902458] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] allow_automatic_dhcp_failover = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.902592] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] allow_bulk = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.902733] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] api_extensions_path = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.902872] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] api_paste_config = api-paste.ini {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903015] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] auth_strategy = keystone {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903149] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] backdoor_port = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903371] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] backdoor_socket = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903458] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] backlog = 4096 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903536] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903693] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] bind_host = 0.0.0.0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903832] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] bind_port = 9696 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.903959] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] client_socket_timeout = 900 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904109] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] config_dir = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904216] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904353] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] config_source = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904490] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] control_exchange = neutron {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904628] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] core_plugin = ml2 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904760] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] debug = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.904896] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] default_availability_zones = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905106] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905241] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] dhcp_agent_notification = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905368] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] dhcp_agents_per_network = 1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905496] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] dhcp_lease_duration = 86400 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905632] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] dhcp_load_type = networks {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905764] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] dns_domain = openstacklocal {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.905896] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906034] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_default_route_bfd = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906177] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_default_route_ecmp = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906327] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_dvr = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906453] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_new_agents = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906579] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906704] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_signals = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906824] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] enable_traditional_dhcp = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.906944] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] external_dns_driver = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907080] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] filter_validation = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907226] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] global_physnet_mtu = 8950 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907354] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] graceful_shutdown_timeout = 60 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907525] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] host = cpu-1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907657] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] host_dvr_for_dhcp = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907783] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] http_retries = 3 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.907916] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] instance_format = [instance: %(uuid)s] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908062] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908196] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ipam_driver = internal {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908323] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ipv6_pd_enabled = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908447] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] l3_ha = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908579] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908707] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] l3_ha_network_physical_name = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908837] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] l3_ha_network_type = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.908974] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_color = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909126] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_config_append = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909286] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909428] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_dir = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909557] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_file = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909660] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_options = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909791] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_rotate_interval = 1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.909930] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_rotate_interval_type = days {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910075] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] log_rotation_type = none {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910176] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910280] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910405] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910562] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910651] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910746] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] max_dns_nameservers = 5 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.910873] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] max_header_line = 16384 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911020] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] max_l3_agents_per_router = 3 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911142] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] max_logfile_count = 30 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911367] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] max_logfile_size_mb = 200 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911474] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] max_subnet_host_routes = 20 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911553] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] my_ip = 10.180.1.21 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911678] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] my_ipv6 = ::1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911808] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] network_auto_schedule = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.911928] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] network_link_prefix = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912076] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912247] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] notify_nova_on_port_data_changes = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912395] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] notify_nova_on_port_status_changes = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912533] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] pagination_max_limit = -1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912659] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] publish_errors = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912788] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] rate_limit_burst = 0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.912963] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] rate_limit_except_level = CRITICAL {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913064] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] rate_limit_interval = 0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913191] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] retry_until_window = 30 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913320] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] router_distributed = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913494] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] rpc_resources_processing_step = 20 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913565] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] rpc_response_max_timeout = 600 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913694] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] rpc_response_timeout = 60 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913817] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] send_events_interval = 2 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.913963] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] service_plugins = ['router'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914112] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] setproctitle = on {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914240] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] shell_completion = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914377] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] state_path = /opt/stack/data/neutron {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914510] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] syslog_log_facility = LOG_USER {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914638] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] tcp_keepidle = 600 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914774] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] transport_url = **** {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.914905] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] use_journal = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915042] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] use_json = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915171] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] use_ssl = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915325] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] use_stderr = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915467] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] use_syslog = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915592] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] vlan_qinq = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915714] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] vlan_transparent = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915844] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] watch_log_file = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.915972] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] wsgi_default_pool_size = 100 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.916112] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] wsgi_keep_alive = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.916250] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.916380] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] wsgi_server_debug = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 542.916522] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_concurrency.disable_process_locking = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.916662] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.916803] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.916937] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917087] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917226] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917653] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917653] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.connection_string = messaging:// {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917653] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.enabled = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917802] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.es_doc_type = notification {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.917886] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.es_scroll_size = 10000 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918029] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.es_scroll_time = 2m {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918163] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.filter_error_trace = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918327] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.hmac_keys = **** {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918471] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.sentinel_service_name = mymaster {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918611] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.socket_timeout = 0.1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918743] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.trace_requests = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.918875] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler.trace_sqlalchemy = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.919030] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler_jaeger.process_tags = {} {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.919163] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler_jaeger.service_name_prefix = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.919295] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] profiler_otlp.service_name_prefix = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.919439] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.enforce_new_defaults = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.919770] env[65162]: WARNING oslo_config.cfg [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 542.919941] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.enforce_scope = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920085] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.policy_default_rule = default {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920258] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920407] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920546] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920673] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920801] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.920926] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921065] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921204] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921396] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921530] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] agent.extensions = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921668] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921802] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] service_providers.service_provider = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.921945] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.default_quota = -1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922100] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922278] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_floatingip = 50 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922422] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_network = 100 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922554] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_port = 500 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922682] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922810] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_router = 10 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.922937] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_security_group = 10 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923076] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923208] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.quota_subnet = 100 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923373] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] QUOTAS.track_quota_usage = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923520] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923648] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.group = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923775] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.helper_command = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.923930] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.log_daemon_traceback = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924050] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924183] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.thread_pool_size = 8 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924315] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep.user = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924450] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924574] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.group = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924699] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.helper_command = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924827] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.924958] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925098] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925237] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_dhcp_release.user = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925394] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925521] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.group = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925646] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925775] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.925908] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926049] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926181] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_ovs_vsctl.user = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926317] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.capabilities = [21] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926441] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.group = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926566] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.helper_command = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926694] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926826] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.926955] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927090] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_namespace.user = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927227] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.capabilities = [12] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927355] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.group = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927479] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.helper_command = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927607] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927739] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927867] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.927991] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_conntrack.user = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928143] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.capabilities = [12, 21] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928287] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.group = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928425] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.helper_command = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928557] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.log_daemon_traceback = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928690] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928819] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.thread_pool_size = 8 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.928940] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] privsep_link.user = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929104] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929253] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929391] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.continue_on_failed_promotions = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929522] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.dscp = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929655] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.dscp_inherit = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929796] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.force_mp_to_policy = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.929928] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.locking_coordinator_url = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930075] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.log_agent_heartbeats = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930210] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.logging_expire = 1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930351] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930485] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930623] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.polling_interval = 240 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930756] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.930894] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931046] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.report_interval = 30.0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931192] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931352] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931502] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931637] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.sync_skew = 60 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931788] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.synchronization_queue_size = 20 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.931900] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT.use_helper_for_ns_read = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932048] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] SECURITYGROUP.enable_ipset = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932220] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] SECURITYGROUP.enable_security_group = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932373] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932516] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932654] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] experimental.ipv6_pd_enabled = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932807] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.extension_drivers = ['port_security'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.932937] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.external_network_type = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933097] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933240] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.overlay_ip_version = 4 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933377] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.path_mtu = 8950 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933519] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.physical_network_mtus = {} {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933662] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933808] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.933938] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ml2.type_drivers = ['vlan'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934089] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934221] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934374] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934549] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934699] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934841] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.934979] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.935134] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.935273] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.935476] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.935620] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_login_password = **** {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.935763] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.935902] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_login_user = admin {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936055] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936197] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936331] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936461] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936599] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936741] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.936878] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937025] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937160] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937301] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937469] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937608] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937746] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.937941] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938100] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938241] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938375] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938511] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.auth_section = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938653] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.auth_type = password {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938789] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.938952] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.certfile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939100] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.collect_timing = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939242] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.endpoint_type = public {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939374] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.insecure = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939499] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.keyfile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939635] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.region_name = RegionOne {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939764] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.split_loggers = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.939889] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] nova.timeout = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940033] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.auth_section = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940201] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.auth_type = password {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940353] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940481] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.certfile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940610] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.collect_timing = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940771] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.endpoint_type = public {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.940913] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.insecure = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941057] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.keyfile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941185] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.region_name = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941316] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.split_loggers = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941440] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] placement.timeout = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941578] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.auth_section = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941705] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.auth_type = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941914] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.cafile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.941961] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.certfile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942085] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.collect_timing = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942237] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.connect_retries = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942375] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.connect_retry_delay = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942505] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.enable_notifications = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942630] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.endpoint_override = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942759] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.insecure = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.942887] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.interface = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943023] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.keyfile = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943189] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.max_version = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943336] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.min_version = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943466] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.region_name = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943593] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.retriable_status_codes = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943717] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.service_name = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943839] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.service_type = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.943971] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.split_loggers = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944101] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.status_code_retries = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944229] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.status_code_retry_delay = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944357] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.timeout = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944511] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.valid_interfaces = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944699] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ironic.version = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944855] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] cli_script.dry_run = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.944999] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.945146] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.945280] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.945413] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.945544] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.945713] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.945882] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946030] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946166] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946307] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946435] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946572] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946705] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946837] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.946966] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947115] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947248] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947379] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947513] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947640] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947769] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.947896] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948033] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948167] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948296] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948423] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948550] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948695] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948838] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.948969] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949112] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.ssl = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949251] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949389] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949517] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949649] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949783] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.949911] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.950062] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_notifications.driver = [] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.950194] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_notifications.retry = -1 {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.950340] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.950467] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 542.950568] env[65162]: DEBUG oslo_service.backend._eventlet.service [None req-cab6a527-f263-4d95-88c0-25cc88ee8fd2 None None] ******************************************************************************** {{(pid=65162) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 542.951734] env[65162]: DEBUG neutron.agent.securitygroups_rpc [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Init firewall settings (driver=nsxv3) {{(pid=65162) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 542.953141] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65162) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 542.953391] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] RPC agent_id: nsxm-l-01a.corp.local [ 542.955640] env[65162]: DEBUG dogpile.cache.region [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 542.955760] env[65162]: DEBUG dogpile.lock [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 542.955857] env[65162]: DEBUG dogpile.lock [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 542.955946] env[65162]: DEBUG dogpile.lock [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 542.956050] env[65162]: DEBUG dogpile.cache.region [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 542.956138] env[65162]: DEBUG dogpile.lock [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 542.956256] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 542.988783] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Session token - acquiring [ 542.990696] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.990881] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.990988] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.991427] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.002471] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.282395] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 543.303710] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 543.303886] env[65162]: DEBUG dogpile.cache.region [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Cache value generated in 0.348 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 543.303955] env[65162]: DEBUG dogpile.lock [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 543.304090] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Activating Policy API Provider. [ 543.304286] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Looking for the default Infrastructure Rules. [ 543.370996] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Looking for the Default Layer3 Logged Drop Section. [ 543.387919] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 543.388386] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.388558] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.388659] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.388955] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.389308] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.903789] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.406473] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.908702] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Inventory metadata is going to be refreshed. [ 544.909061] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 545.703255] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.703528] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.703579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.703873] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.716688] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 545.717489] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.718087] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 545.735886] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.736114] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.736179] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.736679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.736931] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.737028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 545.737109] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.737199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 545.755774] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.756020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.756135] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.756330] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.756502] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.756644] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 545.777811] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.778179] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.778179] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.778391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.778536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.778676] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 545.799048] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.799278] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.799324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.799606] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.799745] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.799893] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 545.799995] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.800108] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 545.817719] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.817946] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.818206] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.818413] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.818561] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.818701] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 545.818803] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.818904] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 545.837069] env[65162]: DEBUG networking_nsxv3.common.locking [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.837272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.837389] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.837614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.837757] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.837902] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 545.838029] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 545.838107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Inventory metadata have been refreshed. [ 545.838201] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Dryrun:True. Metadata refresh completed. [ 545.838333] env[65162]: DEBUG oslo_concurrency.lockutils [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Releasing lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.840210] env[65162]: INFO neutron.agent.agent_extensions_manager [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Loaded agent extensions: [] [ 545.840990] env[65162]: DEBUG neutron_lib.callbacks.manager [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65162) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 545.895200] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent RPC Daemon Started! [ 545.895362] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:0 started [ 545.895402] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent out of sync with plugin! [ 550.841840] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.842308] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.843191] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.843617] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.845058] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.845483] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.019420] env[65162]: INFO networking_nsxv3.common.synchronization [None req-032e4fe0-dc10-4de1-bb98-26fd46e0c1df demo admin] Enqueued Resource ID: 67c40819-04d3-4d00-add9-dcdf65370c5d with Priority: HIGHEST for action security_group_rules [ 561.019954] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c40819-04d3-4d00-add9-dcdf65370c5d with Priority: HIGHEST for action security_group_rules [ 561.020264] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67c40819-04d3-4d00-add9-dcdf65370c5d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.020438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67c40819-04d3-4d00-add9-dcdf65370c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.020511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67c40819-04d3-4d00-add9-dcdf65370c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.020854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67c40819-04d3-4d00-add9-dcdf65370c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.020941] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67c40819-04d3-4d00-add9-dcdf65370c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.541943] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.542186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.542186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.542854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.542854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.542854] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c40819-04d3-4d00-add9-dcdf65370c5d already deleted. [ 561.542854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67c40819-04d3-4d00-add9-dcdf65370c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.021280] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.021280] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.021999] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.022509] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.845020] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.845020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.845020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.845020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.845937] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.023310] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 576.023587] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 576.349059] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.851118] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.353495] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 577.353743] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 578.184075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.184723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.184723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.184723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.195472] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 578.196468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.197427] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 578.217145] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.217372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.217372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.217562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.217649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.217756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 578.217828] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 578.217899] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 578.237345] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.237566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.237566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.237758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.237890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.238015] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 578.259397] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.259623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.259623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.259794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.259899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.260018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 578.284545] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.284781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.284781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.284993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.285117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.285380] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 578.285380] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 578.285380] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 578.305078] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.305307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.305307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.305483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.305572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.305677] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 578.305746] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 578.305820] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 578.331313] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.331630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.331630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.331775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.331840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.331901] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 578.331977] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 578.332054] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 578.332123] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 578.332196] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 578.332253] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 578.332312] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 578.332629] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 578.332689] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 578.332754] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 578.354548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.354811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.354811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.354993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.355083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.355200] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 578.380189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.380534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.380534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.380677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.380677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.396511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.024415] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 581.024821] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 586.025154] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 586.025782] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 589.373968] env[65162]: INFO networking_nsxv3.common.synchronization [None req-bc231b01-62c4-4384-ba55-d93804c4ae41 None None] Enqueued Resource ID: c5f0f376-fd53-451a-acc0-2cbab44d7b9a with Priority: HIGHEST for action port [ 589.374269] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5f0f376-fd53-451a-acc0-2cbab44d7b9a with Priority: HIGHEST for action port [ 589.374689] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5f0f376-fd53-451a-acc0-2cbab44d7b9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.374811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5f0f376-fd53-451a-acc0-2cbab44d7b9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.374910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5f0f376-fd53-451a-acc0-2cbab44d7b9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.375333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5f0f376-fd53-451a-acc0-2cbab44d7b9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.375467] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5f0f376-fd53-451a-acc0-2cbab44d7b9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.747216] env[65162]: INFO networking_nsxv3.common.synchronization [None req-10a0baea-638d-4e9d-aec7-0b38a9e9f264 None None] Enqueued Resource ID: 6d3438d4-9352-4c62-9497-c2a31a2e554e with Priority: HIGHEST for action port [ 589.747216] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3438d4-9352-4c62-9497-c2a31a2e554e with Priority: HIGHEST for action port [ 589.747216] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d3438d4-9352-4c62-9497-c2a31a2e554e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.747216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d3438d4-9352-4c62-9497-c2a31a2e554e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.747216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d3438d4-9352-4c62-9497-c2a31a2e554e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.747216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d3438d4-9352-4c62-9497-c2a31a2e554e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.747216] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d3438d4-9352-4c62-9497-c2a31a2e554e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.879146] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5f0f376-fd53-451a-acc0-2cbab44d7b9a [ 589.879146] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.879146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.879146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.879146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.879146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.879146] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5f0f376-fd53-451a-acc0-2cbab44d7b9a already deleted. [ 589.879146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5f0f376-fd53-451a-acc0-2cbab44d7b9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.248947] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d3438d4-9352-4c62-9497-c2a31a2e554e [ 590.249198] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.249339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.249409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.249618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.249710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.249804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d3438d4-9352-4c62-9497-c2a31a2e554e already deleted. [ 590.249883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d3438d4-9352-4c62-9497-c2a31a2e554e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.142538] env[65162]: INFO networking_nsxv3.common.synchronization [None req-73133aa0-d4fd-4f5c-8dc4-89f7c8be57bf None None] Enqueued Resource ID: 5ec7e5ad-a999-4926-b653-ecc1817553ba with Priority: HIGHEST for action port [ 591.143153] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7e5ad-a999-4926-b653-ecc1817553ba with Priority: HIGHEST for action port [ 591.143466] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ec7e5ad-a999-4926-b653-ecc1817553ba taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.143595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ec7e5ad-a999-4926-b653-ecc1817553ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.143893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ec7e5ad-a999-4926-b653-ecc1817553ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.143936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ec7e5ad-a999-4926-b653-ecc1817553ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.145422] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ec7e5ad-a999-4926-b653-ecc1817553ba',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.647631] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ec7e5ad-a999-4926-b653-ecc1817553ba [ 591.647968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.647968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.648193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.648243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.648333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.648473] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ec7e5ad-a999-4926-b653-ecc1817553ba already deleted. [ 591.648543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ec7e5ad-a999-4926-b653-ecc1817553ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.311135] env[65162]: INFO networking_nsxv3.common.synchronization [None req-342d6f48-6a27-4667-8604-e590313a20fe None None] Enqueued Resource ID: 8bb2e351-bdf2-4bc2-bbf2-429799bd77d3 with Priority: HIGHEST for action port [ 592.311723] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb2e351-bdf2-4bc2-bbf2-429799bd77d3 with Priority: HIGHEST for action port [ 592.311965] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb2e351-bdf2-4bc2-bbf2-429799bd77d3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.312115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb2e351-bdf2-4bc2-bbf2-429799bd77d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.312304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb2e351-bdf2-4bc2-bbf2-429799bd77d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.312433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb2e351-bdf2-4bc2-bbf2-429799bd77d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.312479] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb2e351-bdf2-4bc2-bbf2-429799bd77d3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.817325] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bb2e351-bdf2-4bc2-bbf2-429799bd77d3 [ 592.817325] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.817325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.817325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.817325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.817325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.817325] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bb2e351-bdf2-4bc2-bbf2-429799bd77d3 already deleted. [ 592.817325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb2e351-bdf2-4bc2-bbf2-429799bd77d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.053101] env[65162]: INFO networking_nsxv3.common.synchronization [None req-92ceb081-5422-42af-bcfd-7d1f4fa18156 None None] Enqueued Resource ID: 7004c01a-bea6-47ca-a80a-e563cb38f103 with Priority: HIGHEST for action port [ 593.053594] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7004c01a-bea6-47ca-a80a-e563cb38f103 with Priority: HIGHEST for action port [ 593.054610] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7004c01a-bea6-47ca-a80a-e563cb38f103 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.055886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7004c01a-bea6-47ca-a80a-e563cb38f103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.057932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7004c01a-bea6-47ca-a80a-e563cb38f103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.057932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7004c01a-bea6-47ca-a80a-e563cb38f103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.057932] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7004c01a-bea6-47ca-a80a-e563cb38f103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.058955] env[65162]: INFO networking_nsxv3.common.synchronization [None req-e8634ee0-8597-4ed0-b00d-0609d256a0d8 None None] Enqueued Resource ID: eb98c392-f2b8-4a47-9b75-44d34d45df75 with Priority: HIGHEST for action port [ 593.060352] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb98c392-f2b8-4a47-9b75-44d34d45df75 with Priority: HIGHEST for action port [ 593.060637] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb98c392-f2b8-4a47-9b75-44d34d45df75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.060752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb98c392-f2b8-4a47-9b75-44d34d45df75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.060845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb98c392-f2b8-4a47-9b75-44d34d45df75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.061067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb98c392-f2b8-4a47-9b75-44d34d45df75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.061199] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb98c392-f2b8-4a47-9b75-44d34d45df75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.560533] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7004c01a-bea6-47ca-a80a-e563cb38f103 [ 593.560533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.560931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.560931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.560931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.561634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.561634] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7004c01a-bea6-47ca-a80a-e563cb38f103 already deleted. [ 593.561634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7004c01a-bea6-47ca-a80a-e563cb38f103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.564602] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb98c392-f2b8-4a47-9b75-44d34d45df75 [ 593.564602] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.564602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.564602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.564602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.564602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.564602] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb98c392-f2b8-4a47-9b75-44d34d45df75 already deleted. [ 593.564602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb98c392-f2b8-4a47-9b75-44d34d45df75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.826262] env[65162]: INFO networking_nsxv3.common.synchronization [None req-3c637070-48d5-448e-a09d-1850425876a0 None None] Enqueued Resource ID: 50d865fe-62a3-427e-b1e3-fbcd965f8926 with Priority: HIGHEST for action port [ 593.826736] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50d865fe-62a3-427e-b1e3-fbcd965f8926 with Priority: HIGHEST for action port [ 593.826855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-50d865fe-62a3-427e-b1e3-fbcd965f8926 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.826983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50d865fe-62a3-427e-b1e3-fbcd965f8926" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.827062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50d865fe-62a3-427e-b1e3-fbcd965f8926" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.827309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50d865fe-62a3-427e-b1e3-fbcd965f8926" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.827384] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50d865fe-62a3-427e-b1e3-fbcd965f8926',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.157264] env[65162]: INFO networking_nsxv3.common.synchronization [None req-330c1dd3-25b9-4bf5-a3fb-69f897109440 None None] Enqueued Resource ID: 5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6 with Priority: HIGHEST for action port [ 594.158345] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6 with Priority: HIGHEST for action port [ 594.158345] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.158345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.158345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.159709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.159810] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.333014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50d865fe-62a3-427e-b1e3-fbcd965f8926 [ 594.333265] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.333399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.333468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.333688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.333796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.333895] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50d865fe-62a3-427e-b1e3-fbcd965f8926 already deleted. [ 594.333981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50d865fe-62a3-427e-b1e3-fbcd965f8926" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.662398] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6 [ 594.664032] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.664032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.664032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.664032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.664032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.664032] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6 already deleted. [ 594.664032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c7f96d7-e9c7-4a34-9948-b85dee5a3ef6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.548364] env[65162]: INFO networking_nsxv3.common.synchronization [None req-a6614cf3-d5cc-44f8-9422-e6c6990a5bfe None None] Enqueued Resource ID: f80373a6-ff42-4655-99a9-89447b37625a with Priority: HIGHEST for action port [ 595.549083] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80373a6-ff42-4655-99a9-89447b37625a with Priority: HIGHEST for action port [ 595.549451] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f80373a6-ff42-4655-99a9-89447b37625a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.549578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f80373a6-ff42-4655-99a9-89447b37625a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.549646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f80373a6-ff42-4655-99a9-89447b37625a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.549894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f80373a6-ff42-4655-99a9-89447b37625a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.550033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f80373a6-ff42-4655-99a9-89447b37625a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.001816] env[65162]: INFO networking_nsxv3.common.synchronization [None req-0facb124-0306-468d-aca9-3801929ef096 None None] Enqueued Resource ID: f32e120e-86fc-43e7-bd00-5275a19f50aa with Priority: HIGHEST for action port [ 596.002883] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32e120e-86fc-43e7-bd00-5275a19f50aa with Priority: HIGHEST for action port [ 596.003200] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f32e120e-86fc-43e7-bd00-5275a19f50aa taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.003758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f32e120e-86fc-43e7-bd00-5275a19f50aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.003846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f32e120e-86fc-43e7-bd00-5275a19f50aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.004129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f32e120e-86fc-43e7-bd00-5275a19f50aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.004214] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f32e120e-86fc-43e7-bd00-5275a19f50aa',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.052453] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f80373a6-ff42-4655-99a9-89447b37625a [ 596.052591] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.052672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.052713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.052996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.052996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.053108] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f80373a6-ff42-4655-99a9-89447b37625a already deleted. [ 596.053458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f80373a6-ff42-4655-99a9-89447b37625a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.510019] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f32e120e-86fc-43e7-bd00-5275a19f50aa [ 596.510019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.510019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.510019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.510019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.510019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.510019] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f32e120e-86fc-43e7-bd00-5275a19f50aa already deleted. [ 596.510019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f32e120e-86fc-43e7-bd00-5275a19f50aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.537368] env[65162]: INFO networking_nsxv3.common.synchronization [None req-65df1d66-6f33-403f-9e11-37519e1c860d None None] Enqueued Resource ID: 0d3500c5-408f-4993-bf5e-16aa7e44e618 with Priority: HIGHEST for action port [ 596.539245] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d3500c5-408f-4993-bf5e-16aa7e44e618 with Priority: HIGHEST for action port [ 596.539591] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d3500c5-408f-4993-bf5e-16aa7e44e618 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.539715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d3500c5-408f-4993-bf5e-16aa7e44e618" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.539786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d3500c5-408f-4993-bf5e-16aa7e44e618" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.540088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d3500c5-408f-4993-bf5e-16aa7e44e618" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.540181] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d3500c5-408f-4993-bf5e-16aa7e44e618',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.043526] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d3500c5-408f-4993-bf5e-16aa7e44e618 [ 597.045062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.045062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.045062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.045062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.045062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.045062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d3500c5-408f-4993-bf5e-16aa7e44e618 already deleted. [ 597.045062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d3500c5-408f-4993-bf5e-16aa7e44e618" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.316430] env[65162]: INFO networking_nsxv3.common.synchronization [None req-45dc6a81-7d20-42e0-b642-e501129fd24d None None] Enqueued Resource ID: 799f482d-cffb-42ad-af1d-edbf2e6043c4 with Priority: HIGHEST for action port [ 597.316686] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799f482d-cffb-42ad-af1d-edbf2e6043c4 with Priority: HIGHEST for action port [ 597.317271] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-799f482d-cffb-42ad-af1d-edbf2e6043c4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.317393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799f482d-cffb-42ad-af1d-edbf2e6043c4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.317510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799f482d-cffb-42ad-af1d-edbf2e6043c4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.317699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799f482d-cffb-42ad-af1d-edbf2e6043c4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.317782] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799f482d-cffb-42ad-af1d-edbf2e6043c4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.824439] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 799f482d-cffb-42ad-af1d-edbf2e6043c4 [ 597.824565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.824710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.824776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.825045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.825138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.825236] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:799f482d-cffb-42ad-af1d-edbf2e6043c4 already deleted. [ 597.825310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799f482d-cffb-42ad-af1d-edbf2e6043c4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.360387] env[65162]: INFO networking_nsxv3.common.synchronization [None req-95cb92e4-1de0-450d-8530-c8f04d8cb7fd None None] Enqueued Resource ID: 19974261-b21c-44ff-b4c1-c13cb0e12432 with Priority: HIGHEST for action port [ 599.360854] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19974261-b21c-44ff-b4c1-c13cb0e12432 with Priority: HIGHEST for action port [ 599.361228] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-19974261-b21c-44ff-b4c1-c13cb0e12432 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.361357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19974261-b21c-44ff-b4c1-c13cb0e12432" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.362866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19974261-b21c-44ff-b4c1-c13cb0e12432" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.362866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19974261-b21c-44ff-b4c1-c13cb0e12432" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.362866] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19974261-b21c-44ff-b4c1-c13cb0e12432',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.467483] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5a36e228-a901-4dea-81f2-e195729c74ae None None] Enqueued Resource ID: 36190695-397c-4202-8df0-10be9b0ec2ec with Priority: HIGHEST for action port [ 599.468767] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36190695-397c-4202-8df0-10be9b0ec2ec with Priority: HIGHEST for action port [ 599.468767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-36190695-397c-4202-8df0-10be9b0ec2ec taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.468767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36190695-397c-4202-8df0-10be9b0ec2ec" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.468767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36190695-397c-4202-8df0-10be9b0ec2ec" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.468767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36190695-397c-4202-8df0-10be9b0ec2ec" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.469158] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36190695-397c-4202-8df0-10be9b0ec2ec',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.867250] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19974261-b21c-44ff-b4c1-c13cb0e12432 [ 599.867493] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.867635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.867705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.867927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.868029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.868119] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19974261-b21c-44ff-b4c1-c13cb0e12432 already deleted. [ 599.869327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19974261-b21c-44ff-b4c1-c13cb0e12432" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.972833] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36190695-397c-4202-8df0-10be9b0ec2ec [ 599.973050] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.973339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.973339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.973472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.973563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.973658] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36190695-397c-4202-8df0-10be9b0ec2ec already deleted. [ 599.973740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36190695-397c-4202-8df0-10be9b0ec2ec" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.548508] env[65162]: INFO networking_nsxv3.common.synchronization [req-d68b93e8-a3bd-4529-ad19-dd2f64ee54ec req-41cb458f-c4bd-4b30-b80d-7cd4ed0e5138 tempest-DeleteServersAdminTestJSON-500387442 tempest-DeleteServersAdminTestJSON-500387442-project-member] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 600.549172] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 600.549495] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.549648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.550966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.550966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.550966] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.550966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.550966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.550966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.550966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.551237] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.854873] env[65162]: INFO networking_nsxv3.common.synchronization [None req-d7c2acad-cd13-4383-b995-6f0779398640 None None] Enqueued Resource ID: 31ad6d25-1cb5-482d-b0b0-f58ffa0c1352 with Priority: HIGHEST for action port [ 600.856310] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ad6d25-1cb5-482d-b0b0-f58ffa0c1352 with Priority: HIGHEST for action port [ 600.856436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-31ad6d25-1cb5-482d-b0b0-f58ffa0c1352 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.856560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31ad6d25-1cb5-482d-b0b0-f58ffa0c1352" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.857013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31ad6d25-1cb5-482d-b0b0-f58ffa0c1352" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.857013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31ad6d25-1cb5-482d-b0b0-f58ffa0c1352" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.857013] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31ad6d25-1cb5-482d-b0b0-f58ffa0c1352',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.053264] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.053409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.053478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.053778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.053855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.054276] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.054381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.054441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.054602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.054740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.054809] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 already deleted. [ 601.054851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.115164] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.115414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.115537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.115879] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.116783] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.116967] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.118233] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.118520] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.118736] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.118960] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.119327] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.119459] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.119591] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.119740] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.119854] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.120028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.144281] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.144281] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.144281] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.144281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.144281] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-85f0b396-da3d-4bd3-a316-e2bab2062a94 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.144281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.144281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.144281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.144281] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85f0b396-da3d-4bd3-a316-e2bab2062a94',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.364047] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31ad6d25-1cb5-482d-b0b0-f58ffa0c1352 [ 601.364047] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.364047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.364047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.364390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.364446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.364791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31ad6d25-1cb5-482d-b0b0-f58ffa0c1352 already deleted. [ 601.364791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31ad6d25-1cb5-482d-b0b0-f58ffa0c1352" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.648795] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.649140] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.649726] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.650194] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.650383] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.650542] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 85f0b396-da3d-4bd3-a316-e2bab2062a94 not found, creating... [ 601.650815] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.651014] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.651131] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.651360] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.651726] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.652917] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.652917] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.652917] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.652917] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.652917] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.652917] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 85f0b396-da3d-4bd3-a316-e2bab2062a94 is going to be created. [ 601.676488] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.676760] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.676839] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.677258] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.677619] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.678146] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.475288] env[65162]: INFO networking_nsxv3.common.synchronization [None req-50175656-df4d-4020-94e7-161e0bce9931 None None] Enqueued Resource ID: ad8ad54c-ee92-4170-9999-a8cf0dc02035 with Priority: HIGHEST for action port [ 602.475815] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8ad54c-ee92-4170-9999-a8cf0dc02035 with Priority: HIGHEST for action port [ 602.479317] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad8ad54c-ee92-4170-9999-a8cf0dc02035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.479317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad8ad54c-ee92-4170-9999-a8cf0dc02035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.479317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad8ad54c-ee92-4170-9999-a8cf0dc02035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.479317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad8ad54c-ee92-4170-9999-a8cf0dc02035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.479317] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad8ad54c-ee92-4170-9999-a8cf0dc02035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.546092] env[65162]: INFO networking_nsxv3.common.synchronization [req-d68b93e8-a3bd-4529-ad19-dd2f64ee54ec req-4aa3cff4-ee05-41f0-8923-b97167a32b90 service nova] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_rules [ 602.546092] env[65162]: INFO networking_nsxv3.common.synchronization [req-d68b93e8-a3bd-4529-ad19-dd2f64ee54ec req-4aa3cff4-ee05-41f0-8923-b97167a32b90 service nova] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 602.546092] env[65162]: INFO networking_nsxv3.common.synchronization [req-d68b93e8-a3bd-4529-ad19-dd2f64ee54ec req-4aa3cff4-ee05-41f0-8923-b97167a32b90 service nova] Enqueued Resource ID: 85f0b396-da3d-4bd3-a316-e2bab2062a94 with Priority: HIGHEST for action port [ 602.546284] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_rules [ 602.546415] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 602.546488] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f0b396-da3d-4bd3-a316-e2bab2062a94 with Priority: HIGHEST for action port [ 602.547132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.547220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.547447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.547701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.547925] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.548700] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.548787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.548929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.549034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.549447] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.549447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.549447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.549588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.549588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.549650] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.550449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-85f0b396-da3d-4bd3-a316-e2bab2062a94 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.551016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.551016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.551259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.551259] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85f0b396-da3d-4bd3-a316-e2bab2062a94',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.981886] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad8ad54c-ee92-4170-9999-a8cf0dc02035 [ 602.981886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.981886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.981886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.981886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.982381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.982381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad8ad54c-ee92-4170-9999-a8cf0dc02035 already deleted. [ 602.982381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad8ad54c-ee92-4170-9999-a8cf0dc02035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.053312] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.054504] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.054615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.056590] env[65162]: INFO networking_nsxv3.common.synchronization [None req-df4862de-0c79-4c72-8ee7-630e1ad64032 None None] Enqueued Resource ID: 4c875e5a-f29d-4097-a0c5-aab9fe74cc79 with Priority: HIGHEST for action port [ 603.057059] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c875e5a-f29d-4097-a0c5-aab9fe74cc79 with Priority: HIGHEST for action port [ 603.057638] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c875e5a-f29d-4097-a0c5-aab9fe74cc79 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.057638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c875e5a-f29d-4097-a0c5-aab9fe74cc79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.057773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c875e5a-f29d-4097-a0c5-aab9fe74cc79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.057994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c875e5a-f29d-4097-a0c5-aab9fe74cc79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.058116] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c875e5a-f29d-4097-a0c5-aab9fe74cc79',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.064142] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85f0b396-da3d-4bd3-a316-e2bab2062a94 with status ACTIVE [ 603.064142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.064142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.064142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.064142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.064142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.066495] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.066495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.066495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.066495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.066495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.066930] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.066930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.066930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.067075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.067075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.067127] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85f0b396-da3d-4bd3-a316-e2bab2062a94 is going to be updated. [ 603.090511] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.090754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.090891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.091025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.091161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.091313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85f0b396-da3d-4bd3-a316-e2bab2062a94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.556925] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.561072] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c875e5a-f29d-4097-a0c5-aab9fe74cc79 [ 603.563030] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.563030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.563030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.563030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.563030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.564140] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c875e5a-f29d-4097-a0c5-aab9fe74cc79 already deleted. [ 603.564140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c875e5a-f29d-4097-a0c5-aab9fe74cc79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.066821] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.066821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.066821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.067235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.067235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.067235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be created. [ 604.092631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.092771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.092830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.093062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.093227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.103955] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: UNINITIALIZED for 2s [ 604.564123] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5ce3b732-05ff-4521-b4f8-0b099e959b49 None None] Enqueued Resource ID: d042940d-1a1b-42a2-83f1-cae88704a209 with Priority: HIGHEST for action port [ 604.564592] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d042940d-1a1b-42a2-83f1-cae88704a209 with Priority: HIGHEST for action port [ 604.564932] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d042940d-1a1b-42a2-83f1-cae88704a209 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.565081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d042940d-1a1b-42a2-83f1-cae88704a209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.565136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d042940d-1a1b-42a2-83f1-cae88704a209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.568713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d042940d-1a1b-42a2-83f1-cae88704a209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.568713] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d042940d-1a1b-42a2-83f1-cae88704a209',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.071109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d042940d-1a1b-42a2-83f1-cae88704a209 [ 605.071393] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.071597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.071597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.073037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.073037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.073037] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d042940d-1a1b-42a2-83f1-cae88704a209 already deleted. [ 605.073037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d042940d-1a1b-42a2-83f1-cae88704a209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.715410] env[65162]: INFO networking_nsxv3.common.synchronization [None req-aeea9a1a-5d8b-4bd6-9858-2d89111f48ac tempest-VolumesAssistedSnapshotsTest-1337621346 tempest-VolumesAssistedSnapshotsTest-1337621346-project-member] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_rules [ 605.716018] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_rules [ 605.717074] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.717074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.717074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.717074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.717074] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.008363] env[65162]: INFO networking_nsxv3.common.synchronization [req-02e96ef4-b5ef-4daa-9dc4-19de7f3f3060 req-468ea06a-32ec-4f65-ad69-ef57da8c8bc3 tempest-ServerDiagnosticsTest-1105926002 tempest-ServerDiagnosticsTest-1105926002-project-member] Enqueued Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_members [ 606.009269] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_members [ 606.009449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.009608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.009723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.010185] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.010711] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.010711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.010711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.011093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.011315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.011496] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.115254] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 606.115254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.115619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.115619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.115950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.115950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.116145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.116228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.116609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.116609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.116609] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.243790] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.244053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.244111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.244369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.244468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.244505] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 already deleted. [ 606.245088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.370686] env[65162]: INFO networking_nsxv3.common.synchronization [None req-0e027e8a-20b4-4d13-9ba9-558269f64172 tempest-VolumesAssistedSnapshotsTest-1337621346 tempest-VolumesAssistedSnapshotsTest-1337621346-project-member] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_rules [ 606.371234] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_rules [ 606.371551] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.371676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.371745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.371941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.374394] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.514889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.515081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.515167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.515865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.516284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.516350] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.516454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.516513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.516757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.516848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.516939] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 already deleted. [ 606.517314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.618548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.618741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.618741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.619086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.619391] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.619391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.619391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.619601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.619635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.620154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.620307] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.620410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.620480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.620675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.620866] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.621042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.621042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.621193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.621285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.621377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.621488] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.896999] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.897182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.897232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.897447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.897524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.897607] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 already deleted. [ 606.900061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.126020] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 523df74a-7dca-4c8d-a869-891ca0abbe71: rpc.has_security_group_logging(os_id): False [ 607.147189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.147284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.147374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.147707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.147707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.147868] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.147947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.147947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.148704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.148704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.148704] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.148704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.148704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.148704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.149033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.149033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.149128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.151659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.151659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.151659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.151659] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be created. [ 607.152859] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.153064] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.153180] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.153406] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.153652] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.153824] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.153939] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.154167] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.154291] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.154482] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.154582] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.154680] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.154796] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.155711] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.155711] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.155711] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.185452] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.185663] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.185738] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.186511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.186915] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.187200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.187360] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.190164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.190164] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2975e24-d9b4-414d-8d1c-d0b012d04aa7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.229474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.230198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.230198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.230198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.230198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.244060] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 2s [ 607.465758] env[65162]: INFO networking_nsxv3.common.synchronization [None req-8f47dfa0-0c4a-4369-b45e-db8143184b4f None None] Enqueued Resource ID: dc891b51-8921-4361-8483-d2348a8effd7 with Priority: HIGHEST for action port [ 607.466685] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc891b51-8921-4361-8483-d2348a8effd7 with Priority: HIGHEST for action port [ 607.467496] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc891b51-8921-4361-8483-d2348a8effd7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.467496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc891b51-8921-4361-8483-d2348a8effd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.467496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc891b51-8921-4361-8483-d2348a8effd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.467923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc891b51-8921-4361-8483-d2348a8effd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.468488] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc891b51-8921-4361-8483-d2348a8effd7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.694442] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.694442] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port f2975e24-d9b4-414d-8d1c-d0b012d04aa7 not found, creating... [ 607.694442] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.694442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.694970] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.694970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.694970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.694970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.694970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.694970] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: f2975e24-d9b4-414d-8d1c-d0b012d04aa7 is going to be created. [ 607.716555] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.716760] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.717411] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.717411] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.717411] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.717652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.767471] env[65162]: INFO networking_nsxv3.common.synchronization [None req-f2cc5b9e-2887-4a6e-a8cd-77d987faaf9a None None] Enqueued Resource ID: cc52b072-9e8e-4f9d-90b4-50aaa035f24e with Priority: HIGHEST for action port [ 607.768403] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc52b072-9e8e-4f9d-90b4-50aaa035f24e with Priority: HIGHEST for action port [ 607.768719] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc52b072-9e8e-4f9d-90b4-50aaa035f24e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.768845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc52b072-9e8e-4f9d-90b4-50aaa035f24e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.768917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc52b072-9e8e-4f9d-90b4-50aaa035f24e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.769339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc52b072-9e8e-4f9d-90b4-50aaa035f24e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.769927] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc52b072-9e8e-4f9d-90b4-50aaa035f24e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.971295] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc891b51-8921-4361-8483-d2348a8effd7 [ 607.971534] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.971667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.971737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.971964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.972075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.972171] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc891b51-8921-4361-8483-d2348a8effd7 already deleted. [ 607.972253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc891b51-8921-4361-8483-d2348a8effd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.271723] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc52b072-9e8e-4f9d-90b4-50aaa035f24e [ 608.272184] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.272184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.272184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.272843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.272935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.273802] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc52b072-9e8e-4f9d-90b4-50aaa035f24e already deleted. [ 608.273802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc52b072-9e8e-4f9d-90b4-50aaa035f24e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.439205] env[65162]: INFO networking_nsxv3.common.synchronization [req-02e96ef4-b5ef-4daa-9dc4-19de7f3f3060 req-1a9b4409-e91d-4bb6-94d5-adbeeffbc524 service nova] Enqueued Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_rules [ 608.439414] env[65162]: INFO networking_nsxv3.common.synchronization [req-02e96ef4-b5ef-4daa-9dc4-19de7f3f3060 req-1a9b4409-e91d-4bb6-94d5-adbeeffbc524 service nova] Enqueued Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_members [ 608.439543] env[65162]: INFO networking_nsxv3.common.synchronization [req-02e96ef4-b5ef-4daa-9dc4-19de7f3f3060 req-1a9b4409-e91d-4bb6-94d5-adbeeffbc524 service nova] Enqueued Resource ID: f2975e24-d9b4-414d-8d1c-d0b012d04aa7 with Priority: HIGHEST for action port [ 608.439761] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_rules [ 608.439939] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_members [ 608.440101] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2975e24-d9b4-414d-8d1c-d0b012d04aa7 with Priority: HIGHEST for action port [ 608.440639] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.440823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.440823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.441516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.441674] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.442612] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.442804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.442857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.445577] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.445577] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.445577] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.445577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.445577] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2975e24-d9b4-414d-8d1c-d0b012d04aa7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.946784] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.947039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.947300] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.948235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2975e24-d9b4-414d-8d1c-d0b012d04aa7 with status ACTIVE [ 608.950344] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.951245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.951245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.951575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.952908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.952908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.952908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.952908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.952908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.952908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.952908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.952908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.953799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.954038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.954462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.954462] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2975e24-d9b4-414d-8d1c-d0b012d04aa7 is going to be updated. [ 608.977752] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.978781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.978781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.978781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.978781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.978781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2975e24-d9b4-414d-8d1c-d0b012d04aa7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.063188] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddcf01e2-424f-4bdc-9199-03d2c5be3d3e req-e33d2289-ee14-4a7b-95ba-b6ced799d151 tempest-FloatingIPsAssociationTestJSON-1766689371 tempest-FloatingIPsAssociationTestJSON-1766689371-project-member] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 609.063188] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 609.063188] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.063188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.063188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.063188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.065925] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.065925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.065925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.065925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.065925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.065925] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.261670] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 609.261967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.456709] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.571206] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.571368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.572011] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.572011] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.572144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.572687] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.572687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.572687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.572687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.572687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.572687] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff already deleted. [ 609.573351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.836322] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-724 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.836322] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.836322] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.836322] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.836322] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.836964] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.837333] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.837669] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.840333] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.840333] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.840333] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.840333] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.840333] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.840333] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.840333] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.840333] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.859896] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.860331] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.860331] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.860568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.860987] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.861165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.861405] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.861757] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.861823] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d435d15-c2f8-45ea-83a2-44e88c2a0fa6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.959769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.959953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.960050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.960362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.960479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.960967] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 is going to be created. [ 609.984277] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.984474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.984539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.984692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.984847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.995731] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 in Status: UNINITIALIZED for 2s [ 610.060181] env[65162]: INFO networking_nsxv3.common.synchronization [req-73cdab20-6faf-4ef3-841a-19faec06893b req-16dae838-bb02-4bb9-85bb-20893295ce1b tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 610.060181] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 610.060181] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.060181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.060181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.060181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.060181] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.061685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.061685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.062921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.063536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.063654] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.364915] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.364915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.364915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.365166] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.365372] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.365542] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 not found, creating... [ 610.365907] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.366146] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.366265] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.366568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.366717] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.367064] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.367224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.367337] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.367598] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.367735] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.367871] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 is going to be created. [ 610.390360] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.390638] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.390763] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.391213] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.391458] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.391723] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.566452] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.566452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.566452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.566893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.566893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.566893] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.567025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.567067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.567936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.567936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.567936] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 already deleted. [ 610.567936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.153681] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddcf01e2-424f-4bdc-9199-03d2c5be3d3e req-5c83ed68-104e-43bd-8878-c50febb3319f service nova] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_rules [ 611.153681] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddcf01e2-424f-4bdc-9199-03d2c5be3d3e req-5c83ed68-104e-43bd-8878-c50febb3319f service nova] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 611.153681] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddcf01e2-424f-4bdc-9199-03d2c5be3d3e req-5c83ed68-104e-43bd-8878-c50febb3319f service nova] Enqueued Resource ID: 8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 with Priority: HIGHEST for action port [ 611.153681] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_rules [ 611.153681] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 611.153681] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 with Priority: HIGHEST for action port [ 611.154111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.154688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.154688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.155929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.155929] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.157741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.157741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.157741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.157741] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.159993] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.159993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.159993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.159993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.159993] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d435d15-c2f8-45ea-83a2-44e88c2a0fa6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.443702] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-369 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.444061] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.444061] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.444383] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.444606] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.444796] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.444869] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.445150] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.445249] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.445458] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.445928] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.445928] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.445928] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.445928] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.445928] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.446141] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.467182] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.467436] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.467516] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.467695] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.468037] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-1840227f-0d67-4cb4-9c3d-4057a1818659 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.468203] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.468321] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.468670] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.468811] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1840227f-0d67-4cb4-9c3d-4057a1818659',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.660826] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.661253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.661253] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.662314] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 with status ACTIVE [ 611.662314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.662620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.662620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.662683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.664403] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.664403] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.664403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.664403] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d435d15-c2f8-45ea-83a2-44e88c2a0fa6 is going to be updated. [ 611.669131] env[65162]: INFO networking_nsxv3.common.synchronization [None req-daf53c90-009e-438c-b352-0bf7a4a73e3d None None] Enqueued Resource ID: 11a19188-7ef7-4879-be41-024521ef461a with Priority: HIGHEST for action port [ 611.669467] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11a19188-7ef7-4879-be41-024521ef461a with Priority: HIGHEST for action port [ 611.669964] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-11a19188-7ef7-4879-be41-024521ef461a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.670148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11a19188-7ef7-4879-be41-024521ef461a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.670148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11a19188-7ef7-4879-be41-024521ef461a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.670365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11a19188-7ef7-4879-be41-024521ef461a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.670447] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11a19188-7ef7-4879-be41-024521ef461a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.685765] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.685955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.686056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.686271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.687254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.687254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d435d15-c2f8-45ea-83a2-44e88c2a0fa6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.971605] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.971817] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.972840] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.972840] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.972840] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.972840] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 1840227f-0d67-4cb4-9c3d-4057a1818659 not found, creating... [ 611.972840] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.973063] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.973063] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.973246] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.973369] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.973650] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.973810] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.973949] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.974603] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.974737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.974870] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 1840227f-0d67-4cb4-9c3d-4057a1818659 is going to be created. [ 611.997312] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.997503] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.998510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.998510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.998510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.998510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.008597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 in Status: SUCCESS [ 612.008839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.009012] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.009226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.009419] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.009535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.009629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.009745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.009826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.009912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.010012] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.165857] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.174041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11a19188-7ef7-4879-be41-024521ef461a [ 612.174314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.174582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.174582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.174729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.174820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.174907] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11a19188-7ef7-4879-be41-024521ef461a already deleted. [ 612.174984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11a19188-7ef7-4879-be41-024521ef461a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.512079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.512321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.512374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.512614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.512855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.513014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.513063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.513262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.513371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.513531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.513669] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.513781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.513882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.514170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.514261] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.514363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.514444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.515087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.515266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.515385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.515482] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.668056] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.668388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.668388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.668644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.668909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.668909] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be created. [ 612.691792] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.691906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.691985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.692225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.692383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.703396] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: UNINITIALIZED for 2s [ 612.708969] env[65162]: INFO networking_nsxv3.common.synchronization [req-73cdab20-6faf-4ef3-841a-19faec06893b req-4d029334-107e-4d56-9a0a-623e1168b65c service nova] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_rules [ 612.709174] env[65162]: INFO networking_nsxv3.common.synchronization [req-73cdab20-6faf-4ef3-841a-19faec06893b req-4d029334-107e-4d56-9a0a-623e1168b65c service nova] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 612.709322] env[65162]: INFO networking_nsxv3.common.synchronization [req-73cdab20-6faf-4ef3-841a-19faec06893b req-4d029334-107e-4d56-9a0a-623e1168b65c service nova] Enqueued Resource ID: 1840227f-0d67-4cb4-9c3d-4057a1818659 with Priority: HIGHEST for action port [ 612.709842] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_rules [ 612.710015] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 612.710248] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1840227f-0d67-4cb4-9c3d-4057a1818659 with Priority: HIGHEST for action port [ 612.710575] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.710755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.710867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.711204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.711331] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.712586] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.712700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.712794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.713015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.713194] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.714321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.716096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.716326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.716451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.716570] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.717427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-1840227f-0d67-4cb4-9c3d-4057a1818659 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.717536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.717606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.717817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.717912] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1840227f-0d67-4cb4-9c3d-4057a1818659',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.019320] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f397b1-dc10-4ae4-92be-e4aad1bdbb08: rpc.has_security_group_logging(os_id): False [ 613.039166] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.040055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.040055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.040055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.041579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.041579] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.041579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.041579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.041829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.041829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.042107] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.042107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.042195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.042290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.042545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.042692] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.042692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.042918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.042918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.042978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.043486] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 is going to be created. [ 613.104226] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.104369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.104439] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.104650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.104831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.112198] env[65162]: INFO networking_nsxv3.common.synchronization [None req-de02d656-9f6e-4915-a55e-d3a209312a69 None None] Enqueued Resource ID: 54b3c7ae-bd7f-4604-ad9a-fd81350fc550 with Priority: HIGHEST for action port [ 613.112409] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b3c7ae-bd7f-4604-ad9a-fd81350fc550 with Priority: HIGHEST for action port [ 613.113063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-54b3c7ae-bd7f-4604-ad9a-fd81350fc550 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.113351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54b3c7ae-bd7f-4604-ad9a-fd81350fc550" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.113351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54b3c7ae-bd7f-4604-ad9a-fd81350fc550" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.118222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54b3c7ae-bd7f-4604-ad9a-fd81350fc550" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.118362] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b3c7ae-bd7f-4604-ad9a-fd81350fc550',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.120260] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 in Status: IN_PROGRESS for 2s [ 613.220663] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.220663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.220786] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.221691] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1840227f-0d67-4cb4-9c3d-4057a1818659 with status ACTIVE [ 613.221989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.222129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.222191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.222403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.222578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.222682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.222769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.222852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.223027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.223119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.223325] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.224018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.224018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.224018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.224018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.224018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1840227f-0d67-4cb4-9c3d-4057a1818659 is going to be updated. [ 613.261253] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.261657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.261848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.263062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.263062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.263180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1840227f-0d67-4cb4-9c3d-4057a1818659" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.624257] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54b3c7ae-bd7f-4604-ad9a-fd81350fc550 [ 613.624257] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.624257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.624257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.624257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.624257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.624257] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54b3c7ae-bd7f-4604-ad9a-fd81350fc550 already deleted. [ 613.624257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54b3c7ae-bd7f-4604-ad9a-fd81350fc550" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.726140] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.789762] env[65162]: INFO networking_nsxv3.common.synchronization [None req-90b88c4b-995f-4ba1-bc89-a581941fe590 None None] Enqueued Resource ID: f1e69fc6-f131-4c02-9557-549d7d1299e9 with Priority: HIGHEST for action port [ 613.790379] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1e69fc6-f131-4c02-9557-549d7d1299e9 with Priority: HIGHEST for action port [ 613.790548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1e69fc6-f131-4c02-9557-549d7d1299e9 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.790711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1e69fc6-f131-4c02-9557-549d7d1299e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.790748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1e69fc6-f131-4c02-9557-549d7d1299e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.791092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1e69fc6-f131-4c02-9557-549d7d1299e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.791176] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1e69fc6-f131-4c02-9557-549d7d1299e9',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.229233] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.229413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.229498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.229778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.229901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.230022] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be created. [ 614.268071] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.268071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.268071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.268071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.268071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.288226] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: UNINITIALIZED for 2s [ 614.297833] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1e69fc6-f131-4c02-9557-549d7d1299e9 [ 614.297833] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.297833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.297833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.298459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.298459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.298459] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1e69fc6-f131-4c02-9557-549d7d1299e9 already deleted. [ 614.298459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1e69fc6-f131-4c02-9557-549d7d1299e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.715305] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 614.715574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.715747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.715972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.716179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.716300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.716365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.716518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.716741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.717168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.717168] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.931294] env[65162]: INFO networking_nsxv3.common.synchronization [req-c7a9ac80-c7b7-4445-9524-5ce525d06f95 req-eaa37df4-a9e9-4091-bac4-d5e3cc7f3812 tempest-MigrationsAdminTest-350875998 tempest-MigrationsAdminTest-350875998-project-member] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 614.932075] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 614.932229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.932365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.932365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.932839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.932839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.932994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.933048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.933215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.934817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.934817] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.013731] env[65162]: INFO networking_nsxv3.common.synchronization [req-f7e8d269-aa34-42ad-88b6-b209c9a8ad3e req-543e07ec-d644-4684-ba62-b602f8649466 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 615.014257] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 615.014556] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.014676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.014743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.014992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.016204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.016204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.016204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.016204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.016204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.016204] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.135826] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 in Status: SUCCESS [ 615.136126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.149940] env[65162]: INFO networking_nsxv3.common.synchronization [None req-0686e158-e76c-41b8-b72f-8c0b02cfc3a0 None None] Enqueued Resource ID: b3ecff98-c9bc-475b-bf97-689fb804dec7 with Priority: HIGHEST for action port [ 615.150602] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ecff98-c9bc-475b-bf97-689fb804dec7 with Priority: HIGHEST for action port [ 615.151393] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3ecff98-c9bc-475b-bf97-689fb804dec7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.151571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3ecff98-c9bc-475b-bf97-689fb804dec7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.151895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3ecff98-c9bc-475b-bf97-689fb804dec7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.152858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3ecff98-c9bc-475b-bf97-689fb804dec7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.152989] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3ecff98-c9bc-475b-bf97-689fb804dec7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.220878] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.221066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.222124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.222401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.222512] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.222600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.223093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.225577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.225577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.225577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.225577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.225577] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.436268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.436425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.436592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.436861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.437755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.437755] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.437755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.437755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.437755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.437755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.437755] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 already deleted. [ 615.437755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.519368] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.519565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.519677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.519944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.520070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.520317] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.520432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.520520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.520720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.520814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.520931] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 already deleted. [ 615.521045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.656722] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3ecff98-c9bc-475b-bf97-689fb804dec7 [ 615.656722] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.656722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.656722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.656722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.656722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.656722] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3ecff98-c9bc-475b-bf97-689fb804dec7 already deleted. [ 615.656722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3ecff98-c9bc-475b-bf97-689fb804dec7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.726875] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3335dfc0-bd35-4429-ae08-fe5e4847acff: rpc.has_security_group_logging(os_id): False [ 615.747479] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.747628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.747720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.747912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.748029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.748220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.748321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.748386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.748521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.748598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.748767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.748859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.748921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.749075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.749150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.749324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.749673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.749673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.749673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.749673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.749897] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be created. [ 615.829367] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.829618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.829707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.829995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.830691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.841696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: IN_PROGRESS for 2s [ 616.216363] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.216764] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.216968] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.217175] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.217565] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.217777] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.217959] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.219094] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.219094] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.219094] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.219094] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.219094] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.219311] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.219355] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.219501] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.219692] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.241515] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.241704] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.241816] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.241995] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.242333] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.242598] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.242598] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.243708] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.243708] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41e5ffe2-e8a6-466b-be0c-a05c1fd030c3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.298388] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 616.298614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.298784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.299023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.299229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.299353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.299420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.299580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.299664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.299749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.299842] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.363364] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.363814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.363814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.364117] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.364377] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.364526] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.364635] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.364842] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.364980] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.365191] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.365308] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.365392] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.365489] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.365587] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.365682] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.366037] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.385137] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.385299] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.385392] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.385568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.385871] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.386060] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.386178] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.386522] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.386804] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a163cd-f57f-43b7-a2c1-01bd775a4bfd',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.460758] env[65162]: INFO networking_nsxv3.common.synchronization [None req-1edd29f2-c4b6-44a5-88a1-fdd66914e3ff None None] Enqueued Resource ID: 1d403df1-5b0e-43f8-8d68-e7565b6e1cc2 with Priority: HIGHEST for action port [ 616.461368] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d403df1-5b0e-43f8-8d68-e7565b6e1cc2 with Priority: HIGHEST for action port [ 616.461699] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d403df1-5b0e-43f8-8d68-e7565b6e1cc2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.461830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d403df1-5b0e-43f8-8d68-e7565b6e1cc2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.461918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d403df1-5b0e-43f8-8d68-e7565b6e1cc2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.462197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d403df1-5b0e-43f8-8d68-e7565b6e1cc2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.462278] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d403df1-5b0e-43f8-8d68-e7565b6e1cc2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.745411] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.745655] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.745787] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.746100] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.746252] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.746399] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 not found, creating... [ 616.746651] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.746843] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.747053] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.747131] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.747263] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.747534] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.747692] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.747793] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.748049] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.748188] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.748323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 is going to be created. [ 616.768155] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.768415] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.768514] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.768815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.769176] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.769275] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.802237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.802388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.802536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.802651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.803257] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.803376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.803424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.803604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.803691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.803779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.803944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.804123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.804123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.804258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.804392] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.805516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.805516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.805516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.805516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.805516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.805516] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.807303] env[65162]: INFO networking_nsxv3.common.synchronization [None req-9a485505-e104-4093-9be7-ee346fae0910 None None] Enqueued Resource ID: b3684f04-b591-430c-808c-f434b522080f with Priority: HIGHEST for action port [ 616.808784] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3684f04-b591-430c-808c-f434b522080f with Priority: HIGHEST for action port [ 616.809337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3684f04-b591-430c-808c-f434b522080f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.809337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3684f04-b591-430c-808c-f434b522080f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.809337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3684f04-b591-430c-808c-f434b522080f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.809549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3684f04-b591-430c-808c-f434b522080f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.809631] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3684f04-b591-430c-808c-f434b522080f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.888850] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.889163] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.889289] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.889655] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.889817] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.890049] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 65a163cd-f57f-43b7-a2c1-01bd775a4bfd not found, creating... [ 616.890395] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.890601] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.890729] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.890965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.891122] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.891418] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.891567] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.891677] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.891880] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.892049] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.892188] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 65a163cd-f57f-43b7-a2c1-01bd775a4bfd is going to be created. [ 616.916079] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.916433] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.916568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.916840] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.917086] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.917308] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.964450] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d403df1-5b0e-43f8-8d68-e7565b6e1cc2 [ 616.964682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.964818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.964881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.965165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.965274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.965369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d403df1-5b0e-43f8-8d68-e7565b6e1cc2 already deleted. [ 616.965451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d403df1-5b0e-43f8-8d68-e7565b6e1cc2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.308534] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dd59e3c-797c-4664-8f76-fa18f1a811b1: rpc.has_security_group_logging(os_id): False [ 617.311318] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3684f04-b591-430c-808c-f434b522080f [ 617.311525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.311732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.311732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.311961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.312042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.312117] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3684f04-b591-430c-808c-f434b522080f already deleted. [ 617.312196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3684f04-b591-430c-808c-f434b522080f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.329525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.329742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.329742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.329955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.330057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.330248] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.330342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.330402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.330556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.330635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.330897] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.330999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.331067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.331215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.331289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.331463] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.331553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.331612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.331750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.331826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.331904] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be created. [ 617.387971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.387971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.387971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.387971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.387971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.399191] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 617.528368] env[65162]: INFO networking_nsxv3.common.synchronization [req-c7a9ac80-c7b7-4445-9524-5ce525d06f95 req-f28446eb-844c-46db-aa70-880e78e9adb4 service nova] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_rules [ 617.528557] env[65162]: INFO networking_nsxv3.common.synchronization [req-c7a9ac80-c7b7-4445-9524-5ce525d06f95 req-f28446eb-844c-46db-aa70-880e78e9adb4 service nova] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 617.528684] env[65162]: INFO networking_nsxv3.common.synchronization [req-c7a9ac80-c7b7-4445-9524-5ce525d06f95 req-f28446eb-844c-46db-aa70-880e78e9adb4 service nova] Enqueued Resource ID: 41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 with Priority: HIGHEST for action port [ 617.529306] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_rules [ 617.529484] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 617.529591] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 with Priority: HIGHEST for action port [ 617.529905] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.530178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.530272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.530589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.530706] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.532210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.533486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.533486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.534054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.534120] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.534200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.536454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.536454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.536454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.536454] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.536454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.536454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.536454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.536454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.537165] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41e5ffe2-e8a6-466b-be0c-a05c1fd030c3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.649451] env[65162]: INFO networking_nsxv3.common.synchronization [req-f7e8d269-aa34-42ad-88b6-b209c9a8ad3e req-f477473d-0e11-4ea9-9bc6-2838438d2f5c service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 617.649615] env[65162]: INFO networking_nsxv3.common.synchronization [req-f7e8d269-aa34-42ad-88b6-b209c9a8ad3e req-f477473d-0e11-4ea9-9bc6-2838438d2f5c service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 617.649742] env[65162]: INFO networking_nsxv3.common.synchronization [req-f7e8d269-aa34-42ad-88b6-b209c9a8ad3e req-f477473d-0e11-4ea9-9bc6-2838438d2f5c service nova] Enqueued Resource ID: 65a163cd-f57f-43b7-a2c1-01bd775a4bfd with Priority: HIGHEST for action port [ 617.649971] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 617.650118] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 617.650278] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a163cd-f57f-43b7-a2c1-01bd775a4bfd with Priority: HIGHEST for action port [ 617.652733] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.652733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.652733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.652733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.652733] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.654180] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.654180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.654180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.654180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.654180] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.654180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.654180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.654416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.654416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.654416] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.655384] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.655384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.655532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.655658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.655658] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a163cd-f57f-43b7-a2c1-01bd775a4bfd',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.854751] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 617.854970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.038665] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.038844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.039018] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.040062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 with status ACTIVE [ 618.040157] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.040638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.040638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.040638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.040638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.040823] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.040948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.040981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.041152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.041247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.041403] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.041497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.041555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.041716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.041790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.041875] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41e5ffe2-e8a6-466b-be0c-a05c1fd030c3 is going to be updated. [ 618.064017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.064414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.064414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.064494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.064619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.064781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41e5ffe2-e8a6-466b-be0c-a05c1fd030c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.158083] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.159677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.159811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.160742] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65a163cd-f57f-43b7-a2c1-01bd775a4bfd with status ACTIVE [ 618.160742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.160742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.160742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.160742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.160742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.160742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.161375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.161375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.166129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.166129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.166129] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.166129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.166129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.166129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.166129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.166129] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65a163cd-f57f-43b7-a2c1-01bd775a4bfd is going to be updated. [ 618.200088] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.200274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.200330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.204028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.204028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.204028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65a163cd-f57f-43b7-a2c1-01bd775a4bfd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.544731] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.666765] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.739771] env[65162]: INFO networking_nsxv3.common.synchronization [req-f59f5775-1430-4eb0-8096-abe7daa398bd req-d39a2292-dff8-4ff8-96bf-daf065ac9418 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 618.740442] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 618.740769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.740885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.049499] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.049665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.050448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.050999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.053632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.053632] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be created. [ 619.076994] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.078226] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.078388] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.078826] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.079139] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.079309] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.079422] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.080028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.080028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.080028] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.080231] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.080231] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.080306] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.080387] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.080598] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.080598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.083021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.083021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.083021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.084468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.084468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.095973] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: UNINITIALIZED for 2s [ 619.105747] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.106260] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.106260] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.106260] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.106529] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-89651811-61c1-4370-a6f2-333f219512e7 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.106705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.106827] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.107166] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.107308] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89651811-61c1-4370-a6f2-333f219512e7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.170997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.171203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.171273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.171496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.171588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.171687] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be created. [ 619.198934] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.199108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.199188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.199434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.199630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.210174] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: UNINITIALIZED for 2s [ 619.310105] env[65162]: INFO networking_nsxv3.common.synchronization [None req-24cf875c-4b14-4b4f-b91e-9ce81d37f72b None None] Enqueued Resource ID: 2071009a-6d69-46dc-9ef0-f521c0f25088 with Priority: HIGHEST for action port [ 619.310895] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2071009a-6d69-46dc-9ef0-f521c0f25088 with Priority: HIGHEST for action port [ 619.312245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2071009a-6d69-46dc-9ef0-f521c0f25088 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.312245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2071009a-6d69-46dc-9ef0-f521c0f25088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.312245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2071009a-6d69-46dc-9ef0-f521c0f25088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.312245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2071009a-6d69-46dc-9ef0-f521c0f25088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.312245] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2071009a-6d69-46dc-9ef0-f521c0f25088',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.412804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 619.413865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.611170] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.611514] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.611647] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.611925] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.612092] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.612828] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 89651811-61c1-4370-a6f2-333f219512e7 not found, creating... [ 619.612828] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.612828] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.612828] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.614394] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.614694] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.615073] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.615248] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.615359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.616734] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.616734] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.616734] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 89651811-61c1-4370-a6f2-333f219512e7 is going to be created. [ 619.641489] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.641737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.641737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.642111] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.642530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.642530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.814333] env[65162]: INFO networking_nsxv3.common.synchronization [None req-6dff62f5-adf7-45e0-803a-1599986803c6 None None] Enqueued Resource ID: 57bc3806-2f39-4a16-a56e-93a757db7ab9 with Priority: HIGHEST for action port [ 619.814627] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2071009a-6d69-46dc-9ef0-f521c0f25088 [ 619.814831] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.814950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.815046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.815248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.815341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.815516] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2071009a-6d69-46dc-9ef0-f521c0f25088 already deleted. [ 619.815622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2071009a-6d69-46dc-9ef0-f521c0f25088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.816214] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bc3806-2f39-4a16-a56e-93a757db7ab9 with Priority: HIGHEST for action port [ 619.816500] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-57bc3806-2f39-4a16-a56e-93a757db7ab9 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.816500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57bc3806-2f39-4a16-a56e-93a757db7ab9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.816500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57bc3806-2f39-4a16-a56e-93a757db7ab9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.816818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57bc3806-2f39-4a16-a56e-93a757db7ab9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.817057] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57bc3806-2f39-4a16-a56e-93a757db7ab9',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.319468] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57bc3806-2f39-4a16-a56e-93a757db7ab9 [ 620.319733] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.320109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.320219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.320610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.320718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.320887] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57bc3806-2f39-4a16-a56e-93a757db7ab9 already deleted. [ 620.321053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57bc3806-2f39-4a16-a56e-93a757db7ab9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.393754] env[65162]: INFO networking_nsxv3.common.synchronization [req-f59f5775-1430-4eb0-8096-abe7daa398bd req-d3b50b01-5d1e-4ceb-b6af-1610929bad57 service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 620.393804] env[65162]: INFO networking_nsxv3.common.synchronization [req-f59f5775-1430-4eb0-8096-abe7daa398bd req-d3b50b01-5d1e-4ceb-b6af-1610929bad57 service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 620.393917] env[65162]: INFO networking_nsxv3.common.synchronization [req-f59f5775-1430-4eb0-8096-abe7daa398bd req-d3b50b01-5d1e-4ceb-b6af-1610929bad57 service nova] Enqueued Resource ID: 89651811-61c1-4370-a6f2-333f219512e7 with Priority: HIGHEST for action port [ 620.394702] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 620.394872] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 620.395072] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89651811-61c1-4370-a6f2-333f219512e7 with Priority: HIGHEST for action port [ 620.395393] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.395531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.395829] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.395829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.396072] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-89651811-61c1-4370-a6f2-333f219512e7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.396221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.396292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.396538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.396677] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89651811-61c1-4370-a6f2-333f219512e7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.896523] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c2d719cd-166c-46cc-bf15-41331fd362f8 tempest-ServerActionsV293TestJSON-1615156236 tempest-ServerActionsV293TestJSON-1615156236-project-member] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_rules [ 620.897228] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_rules [ 620.897569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.897736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.897806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.898143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.898227] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.900623] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89651811-61c1-4370-a6f2-333f219512e7 with status ACTIVE [ 620.900921] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.901398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.901496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.903307] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.903307] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.904583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.904583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.904583] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89651811-61c1-4370-a6f2-333f219512e7 is going to be updated. [ 620.933930] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.934694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.934694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.934694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.935039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.935373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89651811-61c1-4370-a6f2-333f219512e7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.108508] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 621.108730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.108947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.109205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.109400] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.111685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.111685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.111685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.111685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.111685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.111685] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.223625] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 621.223950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.224233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.224553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.224735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.224927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.225054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.225266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.225401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.225489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.225614] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.226597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.227834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.228149] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.228356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.228356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.228536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.228536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.228607] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.255940] env[65162]: INFO networking_nsxv3.common.synchronization [None req-e65eb1b9-2528-403c-8e90-0e1888d2cbe0 tempest-ServerActionsV293TestJSON-1615156236 tempest-ServerActionsV293TestJSON-1615156236-project-member] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_rules [ 621.259352] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_rules [ 621.260390] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.260544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.421102] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.421523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.421523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.423166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.423271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.423422] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 already deleted. [ 621.423534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.423748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.424020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.424147] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.612597] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.612767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.612921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.613156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.613330] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.613430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.613495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.613720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.613810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.613942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.614552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.614552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.614552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.614552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.614552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.614776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.614776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.614835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.615058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.615166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.615290] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.730630] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.730785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.730956] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.946184] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.946502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.946502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.947324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.947324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.947324] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 already deleted. [ 621.947324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.117854] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afc090b2-bc85-4f97-aa84-42fe4b3085b7: rpc.has_security_group_logging(os_id): False [ 622.139386] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.139386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.139491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.139642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.139761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.139910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.140010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.140072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.140219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.140819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.140819] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.140819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.140819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.140819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.140819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.141153] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.141485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.141566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.141718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.141796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.141885] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be created. [ 622.213027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.213027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.213027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.213027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.213027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.226485] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 622.236288] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.738783] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.738783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.738783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.738783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.738783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.738783] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 622.778932] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.779058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.779058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.779750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.779750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.791682] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 623.896129] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4a1011f-f139-4783-8839-94632baa5236 req-f4838f82-39f7-494c-b931-e38729c07534 tempest-VolumesAssistedSnapshotsTest-1337621346 tempest-VolumesAssistedSnapshotsTest-1337621346-project-member] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_members [ 623.896699] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_members [ 623.897118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.897267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.897335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.897652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.897816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.897911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.897971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.898146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.898230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.898323] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.238967] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 624.238967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.388686] env[65162]: INFO networking_nsxv3.common.synchronization [req-91d3e708-7cfd-46d1-903f-b1b382245f9f req-6a2336f5-04fc-4026-81eb-a4b7f4cb85c3 tempest-DeleteServersAdminTestJSON-547259908 tempest-DeleteServersAdminTestJSON-547259908-project-admin] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 624.389284] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 624.389960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.390294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.390294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.390443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.390708] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.390708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.390881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.390881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.391066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.391066] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.401173] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.401347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.401407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.401702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.401702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.401895] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.402008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.402078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.402323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.402323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.402393] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 already deleted. [ 624.402455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.748597] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.749197] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.749476] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.749841] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.750544] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.750544] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.750544] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.751021] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.751057] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.751283] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.751402] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.751564] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.751745] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.751929] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.752345] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.752696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.778501] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.779124] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.780487] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.780718] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.781115] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-17ef9f1a-937c-4eb3-aed5-36efb7630650 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.781306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.781425] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.781776] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.781902] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17ef9f1a-937c-4eb3-aed5-36efb7630650',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.805495] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 624.805802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.805990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.806259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.806460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.807194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.807194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.807194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.807194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.807194] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.894682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.895022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.895022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.895372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.895791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.895791] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.895978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.895978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.896613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896613] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be updated. [ 624.929621] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.929782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.929851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.930408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.930586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.942177] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 2s [ 625.285384] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.285593] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.285715] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.285989] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.286152] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.286304] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 17ef9f1a-937c-4eb3-aed5-36efb7630650 not found, creating... [ 625.286558] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.286706] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.286818] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.287044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.287176] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.287446] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.287590] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.287699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.287897] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.288034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.288170] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 17ef9f1a-937c-4eb3-aed5-36efb7630650 is going to be created. [ 625.311274] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.330441] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.330441] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.330441] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.330441] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.330797] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.330797] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.350772] env[65162]: INFO networking_nsxv3.common.synchronization [None req-9db54e13-e440-4e47-a49d-1b592f7c2f5d tempest-ServersWithSpecificFlavorTestJSON-515804645 tempest-ServersWithSpecificFlavorTestJSON-515804645-project-member] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 625.351337] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 625.352092] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.352230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.352301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.352576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.352659] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.814358] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.872778] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.873433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.873507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.873773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.873880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.874036] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db already deleted. [ 625.874123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.006655] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4a1011f-f139-4783-8839-94632baa5236 req-733a7df6-9e35-405b-8a64-c245692b5302 service nova] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_rules [ 626.007253] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4a1011f-f139-4783-8839-94632baa5236 req-733a7df6-9e35-405b-8a64-c245692b5302 service nova] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_members [ 626.007784] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4a1011f-f139-4783-8839-94632baa5236 req-733a7df6-9e35-405b-8a64-c245692b5302 service nova] Enqueued Resource ID: 17ef9f1a-937c-4eb3-aed5-36efb7630650 with Priority: HIGHEST for action port [ 626.008021] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_rules [ 626.008200] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_members [ 626.008335] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17ef9f1a-937c-4eb3-aed5-36efb7630650 with Priority: HIGHEST for action port [ 626.008747] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.008902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.009217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.009459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.009576] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.012155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.012155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.012155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.012155] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.012750] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-17ef9f1a-937c-4eb3-aed5-36efb7630650 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.012750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.012750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.012865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.012894] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17ef9f1a-937c-4eb3-aed5-36efb7630650',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.292893] env[65162]: INFO networking_nsxv3.common.synchronization [None req-a3568676-d07f-49dc-a778-b48a8d05b695 tempest-ServersWithSpecificFlavorTestJSON-515804645 tempest-ServersWithSpecificFlavorTestJSON-515804645-project-member] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 626.293568] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 626.293895] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.294061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.294122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.294322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.294451] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.316784] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.317362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.317473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.317734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.317834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.318808] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 626.361607] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.361816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.361816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.362151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.362309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.377781] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 626.518024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.518024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.518024] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17ef9f1a-937c-4eb3-aed5-36efb7630650 with status ACTIVE [ 626.518024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.518024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.518024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.519616] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.519616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.519616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.519616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.519616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.519616] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17ef9f1a-937c-4eb3-aed5-36efb7630650 is going to be updated. [ 626.546823] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.546823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.546823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.546823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.546823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.546823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17ef9f1a-937c-4eb3-aed5-36efb7630650" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.821396] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.821396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.821396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.821396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.821396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.821396] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db already deleted. [ 626.821396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.953905] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 626.953905] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 deletion is rescheduled due to dependency. [ 626.953905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.018244] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.521670] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.521881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.521944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.522187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.522303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.522426] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 is going to be created. [ 627.556079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.556079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.556079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.556079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.556079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.567081] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a33b05-c764-41fc-b486-255a775ecff1 in Status: UNINITIALIZED for 2s [ 628.113450] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ac18cac3-2fb3-472b-ba4b-c996902e4a4f None None] Enqueued Resource ID: 293e6d22-2340-41a4-8412-87aa31b7d0c7 with Priority: HIGHEST for action port [ 628.114177] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 293e6d22-2340-41a4-8412-87aa31b7d0c7 with Priority: HIGHEST for action port [ 628.114177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-293e6d22-2340-41a4-8412-87aa31b7d0c7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.114693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-293e6d22-2340-41a4-8412-87aa31b7d0c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.115866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-293e6d22-2340-41a4-8412-87aa31b7d0c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.115866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-293e6d22-2340-41a4-8412-87aa31b7d0c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.115866] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('293e6d22-2340-41a4-8412-87aa31b7d0c7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.390577] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 628.392151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.392151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.392533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.392533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.392662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.392662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.392785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.396022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.396022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.396022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.396022] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.619363] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 293e6d22-2340-41a4-8412-87aa31b7d0c7 [ 628.619363] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.619363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.619363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.619363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.619363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.619363] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:293e6d22-2340-41a4-8412-87aa31b7d0c7 already deleted. [ 628.619363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-293e6d22-2340-41a4-8412-87aa31b7d0c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.838717] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ed23c99c-ff15-4279-a242-9cc09c75f5a9 None None] Enqueued Resource ID: b62db46c-0c59-4e3d-8522-9b52eb3f7e59 with Priority: HIGHEST for action port [ 628.838717] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62db46c-0c59-4e3d-8522-9b52eb3f7e59 with Priority: HIGHEST for action port [ 628.838717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b62db46c-0c59-4e3d-8522-9b52eb3f7e59 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.838717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b62db46c-0c59-4e3d-8522-9b52eb3f7e59" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.838717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b62db46c-0c59-4e3d-8522-9b52eb3f7e59" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.840635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b62db46c-0c59-4e3d-8522-9b52eb3f7e59" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.840635] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62db46c-0c59-4e3d-8522-9b52eb3f7e59',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.899277] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24634bde-1ed8-4d4f-9db6-b19816b628d7: rpc.has_security_group_logging(os_id): False [ 628.917523] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.917606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.917676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.918064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.918214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.918465] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.918601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.918686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.921105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.921105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.921105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.921105] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be created. [ 628.987038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.987325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.987325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.987506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.987694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.999754] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 629.344531] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b62db46c-0c59-4e3d-8522-9b52eb3f7e59 [ 629.344821] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.344885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.344975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.345327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.345424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.345508] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b62db46c-0c59-4e3d-8522-9b52eb3f7e59 already deleted. [ 629.345628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b62db46c-0c59-4e3d-8522-9b52eb3f7e59" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.576905] env[65162]: INFO networking_nsxv3.common.synchronization [None req-6449f78f-2e15-46f3-ab56-71b20e10ab64 None None] Enqueued Resource ID: 3a81fa81-e9f1-4a0e-8d73-d380cb524fd7 with Priority: HIGHEST for action port [ 629.577890] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a81fa81-e9f1-4a0e-8d73-d380cb524fd7 with Priority: HIGHEST for action port [ 629.581591] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a33b05-c764-41fc-b486-255a775ecff1 in Status: SUCCESS [ 629.581591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.581591] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a81fa81-e9f1-4a0e-8d73-d380cb524fd7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.581591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a81fa81-e9f1-4a0e-8d73-d380cb524fd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.581591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a81fa81-e9f1-4a0e-8d73-d380cb524fd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.582650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a81fa81-e9f1-4a0e-8d73-d380cb524fd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.582650] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a81fa81-e9f1-4a0e-8d73-d380cb524fd7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.585264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.585528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.585738] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.585873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.585937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.586369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.586369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.586494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.586494] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.733985] env[65162]: INFO networking_nsxv3.common.synchronization [req-01dd4e3a-a8cd-42ab-98e9-8754730b2697 req-410bca45-5d6f-42d6-9482-8cc610d25b95 tempest-ServerPasswordTestJSON-330434700 tempest-ServerPasswordTestJSON-330434700-project-member] Enqueued Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_members [ 629.735316] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_members [ 629.735316] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.735316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.735690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.735978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.736160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.736318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.736318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.736488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.737188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.737293] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.086886] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a81fa81-e9f1-4a0e-8d73-d380cb524fd7 [ 630.086886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.087176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.087176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.087369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.087534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.087592] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a81fa81-e9f1-4a0e-8d73-d380cb524fd7 already deleted. [ 630.087649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a81fa81-e9f1-4a0e-8d73-d380cb524fd7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.091279] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.244778] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.245277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.245277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.245395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.245462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.245629] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.245771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.245771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.245910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.246068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.246192] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 already deleted. [ 630.246192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.266603] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5df6951e-c383-4524-bd37-0c517525ed65 None None] Enqueued Resource ID: 056ccd91-818c-49d7-9b34-139e4968f1d7 with Priority: HIGHEST for action port [ 630.269929] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 056ccd91-818c-49d7-9b34-139e4968f1d7 with Priority: HIGHEST for action port [ 630.271241] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-056ccd91-818c-49d7-9b34-139e4968f1d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.271241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-056ccd91-818c-49d7-9b34-139e4968f1d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.271241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-056ccd91-818c-49d7-9b34-139e4968f1d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.271241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-056ccd91-818c-49d7-9b34-139e4968f1d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.271241] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('056ccd91-818c-49d7-9b34-139e4968f1d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.595284] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19a33b05-c764-41fc-b486-255a775ecff1: rpc.has_security_group_logging(os_id): False [ 630.615883] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.616054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.616122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.616337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.616428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.616666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.616764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.616829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.620706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.620706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.620706] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 is going to be created. [ 630.623785] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.623970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.624408] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.624408] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.625046] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.625212] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.625349] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.625610] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.625754] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.626028] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.626719] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.626719] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.626719] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.626719] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.626719] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.626719] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.647313] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.647434] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.647572] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.647752] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.648315] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-6a785acc-0d90-4119-ab8e-4e990d67ddcd taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.648315] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.648506] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.651759] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.651759] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a785acc-0d90-4119-ab8e-4e990d67ddcd',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.691084] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.691084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.691084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.691084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.691084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.705593] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19a33b05-c764-41fc-b486-255a775ecff1 in Status: IN_PROGRESS for 2s [ 630.776150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 056ccd91-818c-49d7-9b34-139e4968f1d7 [ 630.776423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.776558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.776594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.776796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.776857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.776952] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:056ccd91-818c-49d7-9b34-139e4968f1d7 already deleted. [ 630.777372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-056ccd91-818c-49d7-9b34-139e4968f1d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.016714] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 631.016714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.017117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.017378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.017541] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.156520] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.157187] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.157187] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.157187] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.157359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.157670] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 6a785acc-0d90-4119-ab8e-4e990d67ddcd not found, creating... [ 631.157749] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.157999] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.157999] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.158219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.158319] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.159052] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.159052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.159052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.159052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.159494] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.159615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 6a785acc-0d90-4119-ab8e-4e990d67ddcd is going to be created. [ 631.182771] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.183032] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.183176] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.183535] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.183857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.184230] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.345021] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c6974c2-fb5e-4d7c-91b8-3545de4b0e0e req-847ff8e9-23cb-4c30-8313-d7fe93e9cb24 tempest-ImagesOneServerTestJSON-99976462 tempest-ImagesOneServerTestJSON-99976462-project-member] Enqueued Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_members [ 631.345576] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_members [ 631.345878] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.345990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.346093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.346383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.346553] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.346658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.346718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.346900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.346975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.347046] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.520441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.520441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.520441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.520441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.520629] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.520677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.520714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.521303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.521303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.521303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.521303] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.822030] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b5077e30-5ad3-44d3-b62b-5505c45835eb None None] Enqueued Resource ID: 0dc09165-44d9-4111-ad8e-65dcbc8c4624 with Priority: HIGHEST for action port [ 631.822030] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc09165-44d9-4111-ad8e-65dcbc8c4624 with Priority: HIGHEST for action port [ 631.822030] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dc09165-44d9-4111-ad8e-65dcbc8c4624 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.822030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dc09165-44d9-4111-ad8e-65dcbc8c4624" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.822030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dc09165-44d9-4111-ad8e-65dcbc8c4624" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.822030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dc09165-44d9-4111-ad8e-65dcbc8c4624" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.822030] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dc09165-44d9-4111-ad8e-65dcbc8c4624',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.849886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.850061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.850140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.850460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.850566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.850974] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.850974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.851190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.851224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.851306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.851446] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17b2580d-282c-4150-9de0-918d31fd8103 already deleted. [ 631.851575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.914178] env[65162]: INFO networking_nsxv3.common.synchronization [req-01dd4e3a-a8cd-42ab-98e9-8754730b2697 req-f79fe602-319a-4a0e-bb3c-dea8379022ce service nova] Enqueued Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_rules [ 631.914567] env[65162]: INFO networking_nsxv3.common.synchronization [req-01dd4e3a-a8cd-42ab-98e9-8754730b2697 req-f79fe602-319a-4a0e-bb3c-dea8379022ce service nova] Enqueued Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_members [ 631.914567] env[65162]: INFO networking_nsxv3.common.synchronization [req-01dd4e3a-a8cd-42ab-98e9-8754730b2697 req-f79fe602-319a-4a0e-bb3c-dea8379022ce service nova] Enqueued Resource ID: 6a785acc-0d90-4119-ab8e-4e990d67ddcd with Priority: HIGHEST for action port [ 631.915311] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_rules [ 631.915311] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_members [ 631.915507] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a785acc-0d90-4119-ab8e-4e990d67ddcd with Priority: HIGHEST for action port [ 631.915684] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.915869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.915927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.916377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.916466] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.918932] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.918932] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.918932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.918932] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.919797] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a785acc-0d90-4119-ab8e-4e990d67ddcd taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.919797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.919887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.920284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.920284] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a785acc-0d90-4119-ab8e-4e990d67ddcd',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.023536] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.023705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.024231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.024562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.024942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.025120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.025197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.025443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.025555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.025669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.026172] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.026172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.026304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.026413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.026592] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.026681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.026750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.026888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.027266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.027514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.027706] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.052459] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.053258] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-135" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.053258] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-135" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.053458] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-135" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.053689] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.053815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.053944] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.054470] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.054470] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.054956] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.054956] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.054956] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.055090] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.055223] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.055382] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.055537] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.076386] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.076634] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.076781] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.077016] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-135" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.077428] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-faac7e56-8173-4b9e-b259-b8a843b135b2 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.077747] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.077818] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.078217] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.078444] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faac7e56-8173-4b9e-b259-b8a843b135b2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.258430] env[65162]: INFO networking_nsxv3.common.synchronization [None req-fc9b038f-3081-4168-a330-00bb8e008b92 None None] Enqueued Resource ID: 8aa61870-3746-431e-ab9a-1f9f4609b228 with Priority: HIGHEST for action port [ 632.258430] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa61870-3746-431e-ab9a-1f9f4609b228 with Priority: HIGHEST for action port [ 632.258430] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aa61870-3746-431e-ab9a-1f9f4609b228 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.258430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aa61870-3746-431e-ab9a-1f9f4609b228" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.258430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aa61870-3746-431e-ab9a-1f9f4609b228" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.258430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aa61870-3746-431e-ab9a-1f9f4609b228" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.258430] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aa61870-3746-431e-ab9a-1f9f4609b228',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.324164] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0dc09165-44d9-4111-ad8e-65dcbc8c4624 [ 632.324841] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.325293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.325293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.325293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.325476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.325476] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0dc09165-44d9-4111-ad8e-65dcbc8c4624 already deleted. [ 632.325564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dc09165-44d9-4111-ad8e-65dcbc8c4624" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.421927] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.422148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.424251] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.424874] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a785acc-0d90-4119-ab8e-4e990d67ddcd with status ACTIVE [ 632.424874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.424874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.424874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.425104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.425104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.425162] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.425458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.425458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.425564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.425594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.425747] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.425833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.425890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.426058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.426142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.426221] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a785acc-0d90-4119-ab8e-4e990d67ddcd is going to be updated. [ 632.448345] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.448599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.448599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.449139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.449139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.449139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a785acc-0d90-4119-ab8e-4e990d67ddcd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.530600] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24634bde-1ed8-4d4f-9db6-b19816b628d7: rpc.has_security_group_logging(os_id): False [ 632.557419] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.557606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.557736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.558031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.558145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.558423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.558571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.558658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.558836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.558918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.559115] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.559211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.559273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.559414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.559488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.559666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.559766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.559807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.559971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.560177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.560307] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 632.581402] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.581657] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.581929] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.582292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.582497] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.582750] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port faac7e56-8173-4b9e-b259-b8a843b135b2 not found, creating... [ 632.583133] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.583418] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.583613] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.583893] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.584182] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.584506] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.584691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.584830] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.585112] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.585327] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.585493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: faac7e56-8173-4b9e-b259-b8a843b135b2 is going to be created. [ 632.604414] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.604679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.604809] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.605169] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.605401] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.605679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.675545] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.675754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.675754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.675917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.676072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.692144] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 632.734779] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19a33b05-c764-41fc-b486-255a775ecff1 in Status: SUCCESS [ 632.735087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.760566] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8aa61870-3746-431e-ab9a-1f9f4609b228 [ 632.763256] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.763256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.763256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.763256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.763256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.763256] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8aa61870-3746-431e-ab9a-1f9f4609b228 already deleted. [ 632.763256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aa61870-3746-431e-ab9a-1f9f4609b228" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.929165] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.418523] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c6974c2-fb5e-4d7c-91b8-3545de4b0e0e req-ee85006d-828d-4cdd-9ab7-9e78ffc47446 service nova] Enqueued Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_rules [ 633.418523] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c6974c2-fb5e-4d7c-91b8-3545de4b0e0e req-ee85006d-828d-4cdd-9ab7-9e78ffc47446 service nova] Enqueued Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_members [ 633.419118] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c6974c2-fb5e-4d7c-91b8-3545de4b0e0e req-ee85006d-828d-4cdd-9ab7-9e78ffc47446 service nova] Enqueued Resource ID: faac7e56-8173-4b9e-b259-b8a843b135b2 with Priority: HIGHEST for action port [ 633.419642] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_rules [ 633.420233] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_members [ 633.420233] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faac7e56-8173-4b9e-b259-b8a843b135b2 with Priority: HIGHEST for action port [ 633.420560] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.420625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.420665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.421095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.421855] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.423655] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.423724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.427392] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.427392] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.427392] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-faac7e56-8173-4b9e-b259-b8a843b135b2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.427392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.427392] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faac7e56-8173-4b9e-b259-b8a843b135b2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.432423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.432622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.432622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.432824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.432890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.432956] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 is going to be created. [ 633.463121] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.464038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.464038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.464038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.464038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.476174] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 in Status: UNINITIALIZED for 2s [ 633.605867] env[65162]: INFO networking_nsxv3.common.synchronization [None req-f31b992a-1200-48fc-a7e9-9df4c6537c65 None None] Enqueued Resource ID: 43de45d8-b0ce-4580-bea7-e2401400a094 with Priority: HIGHEST for action port [ 633.606026] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43de45d8-b0ce-4580-bea7-e2401400a094 with Priority: HIGHEST for action port [ 633.606377] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-43de45d8-b0ce-4580-bea7-e2401400a094 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.606648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43de45d8-b0ce-4580-bea7-e2401400a094" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.606648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43de45d8-b0ce-4580-bea7-e2401400a094" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.606964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43de45d8-b0ce-4580-bea7-e2401400a094" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.607079] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43de45d8-b0ce-4580-bea7-e2401400a094',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.927556] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.930345] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faac7e56-8173-4b9e-b259-b8a843b135b2 with status ACTIVE [ 633.931763] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.931763] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.931763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.932188] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.932188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.932188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.939293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.939788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.939788] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faac7e56-8173-4b9e-b259-b8a843b135b2 is going to be updated. [ 633.940801] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.940931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.966198] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.966337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.966412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.966636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.966816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.967098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faac7e56-8173-4b9e-b259-b8a843b135b2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.109937] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43de45d8-b0ce-4580-bea7-e2401400a094 [ 634.110324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.110659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.110824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.111169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.111735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.111735] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43de45d8-b0ce-4580-bea7-e2401400a094 already deleted. [ 634.111735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43de45d8-b0ce-4580-bea7-e2401400a094" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.432145] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.711343] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 634.712283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.934934] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.935255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.935255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.936085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.936647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.936647] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17b2580d-282c-4150-9de0-918d31fd8103 is going to be created. [ 634.971841] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.972250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.972250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.972538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.972624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.988554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17b2580d-282c-4150-9de0-918d31fd8103 in Status: UNINITIALIZED for 2s [ 635.493741] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 in Status: SUCCESS [ 635.493741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.494187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.495126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.495126] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.495126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.495126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.495126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.495126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.495472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.495472] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.000323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.000323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.000323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.000323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.000323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.000323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.000323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.000899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.000899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.000899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.000899] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.000899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.000899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.001132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.001132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.001385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.001385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.001504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.001504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.005020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.005020] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.355168] env[65162]: INFO networking_nsxv3.common.synchronization [None req-463e7bd6-cd74-4a60-903b-d0c802b1a8e3 None None] Enqueued Resource ID: a0663b66-6180-4ccc-9dba-ed024bfa754a with Priority: HIGHEST for action port [ 636.357237] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0663b66-6180-4ccc-9dba-ed024bfa754a with Priority: HIGHEST for action port [ 636.357672] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0663b66-6180-4ccc-9dba-ed024bfa754a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.357846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0663b66-6180-4ccc-9dba-ed024bfa754a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.360205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0663b66-6180-4ccc-9dba-ed024bfa754a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.360205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0663b66-6180-4ccc-9dba-ed024bfa754a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.360205] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0663b66-6180-4ccc-9dba-ed024bfa754a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.505303] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b521adf-a3c4-47a4-a31d-e406ca77ccb7: rpc.has_security_group_logging(os_id): False [ 636.527563] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.528153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.528153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.528329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.529176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.529176] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.529176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.529176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.529176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.529458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.529492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.529583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.529647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.529868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.529963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.530168] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.530291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.530356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.530561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.530674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.530786] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 is going to be created. [ 636.589706] env[65162]: INFO networking_nsxv3.common.synchronization [None req-555633ad-ce6c-4be4-a812-b9804e0e1814 tempest-ServersTestManualDisk-2035761477 tempest-ServersTestManualDisk-2035761477-project-member] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_rules [ 636.590566] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_rules [ 636.591279] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.591444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.592134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.592245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.592323] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.603234] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.603234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.603234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.603432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.603850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.616546] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 in Status: IN_PROGRESS for 2s [ 636.704828] env[65162]: INFO networking_nsxv3.common.synchronization [None req-250c4f3f-8668-431a-932b-8f02208c6e5c tempest-ServersTestManualDisk-2035761477 tempest-ServersTestManualDisk-2035761477-project-member] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_rules [ 636.705228] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_rules [ 636.705646] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.705729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.863259] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0663b66-6180-4ccc-9dba-ed024bfa754a [ 636.863259] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.863259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.863259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.863259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.863259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.863259] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0663b66-6180-4ccc-9dba-ed024bfa754a already deleted. [ 636.863259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0663b66-6180-4ccc-9dba-ed024bfa754a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.003027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17b2580d-282c-4150-9de0-918d31fd8103 in Status: SUCCESS [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.003027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.003027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.003027] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.127148] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.127148] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 already deleted. [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.127148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.127148] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.506484] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.506611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.506651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.506853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.507071] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.509890] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.509890] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.509890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.509890] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.647365] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.647590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.647590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.647814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.648541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.648653] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 already deleted. [ 637.648749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.013442] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17b2580d-282c-4150-9de0-918d31fd8103: rpc.has_security_group_logging(os_id): False [ 638.035720] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.035923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.035923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.036182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.036279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.036631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.036736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.036803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.036968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.037060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.037246] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.037331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.037394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.037534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.037607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.037780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.037871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.037932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.038086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.038154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.038241] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17b2580d-282c-4150-9de0-918d31fd8103 is going to be created. [ 638.110962] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.111284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.111378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.111628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.111829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.126198] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17b2580d-282c-4150-9de0-918d31fd8103 in Status: IN_PROGRESS for 2s [ 638.631772] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 in Status: SUCCESS [ 638.632070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.937216] env[65162]: INFO networking_nsxv3.common.synchronization [req-55a268e0-b554-4e34-a273-f10a79454f52 req-fa0b66e1-9050-47b0-9ad4-8137038d16b8 tempest-ServerExternalEventsTest-958800395 tempest-ServerExternalEventsTest-958800395-project-member] Enqueued Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_members [ 639.937216] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_members [ 639.937216] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.937216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.937216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.937216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.937216] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.937216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.938814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.939013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.939122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.939218] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.140147] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17b2580d-282c-4150-9de0-918d31fd8103 in Status: SUCCESS [ 640.140367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.388075] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.388075] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.388075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.388798] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.388798] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.388798] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.388798] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.388798] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.388798] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.389150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.410791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.410976] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.411080] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.411264] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.411626] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-0b286859-bc83-44cd-bc09-78c346d7e469 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.411966] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.411966] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.412290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.412452] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b286859-bc83-44cd-bc09-78c346d7e469',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.434797] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c2ae041a-3677-489e-997c-10c1dea4f7e9 None None] Enqueued Resource ID: 803a836d-5559-4427-8be9-608957b43dff with Priority: HIGHEST for action port [ 640.435445] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803a836d-5559-4427-8be9-608957b43dff with Priority: HIGHEST for action port [ 640.436083] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-803a836d-5559-4427-8be9-608957b43dff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.436210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-803a836d-5559-4427-8be9-608957b43dff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.436283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-803a836d-5559-4427-8be9-608957b43dff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.436558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-803a836d-5559-4427-8be9-608957b43dff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.436646] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('803a836d-5559-4427-8be9-608957b43dff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.445075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.445075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.445075] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f86c44d7-d532-4841-9243-c4031dd1f02d already deleted. [ 640.445075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.841868] env[65162]: INFO networking_nsxv3.common.synchronization [req-1ee5634f-327c-4b4a-8359-da43d505b99d req-5a419394-28e4-4052-a20f-4708ecd44acc tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 178ddec7-80de-4f00-8a79-ec3131cc1df5 with Priority: HIGHEST for action security_group_rules [ 640.842652] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 178ddec7-80de-4f00-8a79-ec3131cc1df5 with Priority: HIGHEST for action security_group_rules [ 640.842652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-178ddec7-80de-4f00-8a79-ec3131cc1df5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.842867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-178ddec7-80de-4f00-8a79-ec3131cc1df5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.842922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-178ddec7-80de-4f00-8a79-ec3131cc1df5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.843426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-178ddec7-80de-4f00-8a79-ec3131cc1df5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.843537] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('178ddec7-80de-4f00-8a79-ec3131cc1df5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.917732] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.917732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.917732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.918013] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.918172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.918338] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 0b286859-bc83-44cd-bc09-78c346d7e469 not found, creating... [ 640.918584] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.918734] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.918855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.919087] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.919413] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.919821] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.920017] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.920183] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.920428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.920614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.920845] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 0b286859-bc83-44cd-bc09-78c346d7e469 is going to be created. [ 640.939202] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 803a836d-5559-4427-8be9-608957b43dff [ 640.939454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.939617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.939679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.939979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.940107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.940225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:803a836d-5559-4427-8be9-608957b43dff already deleted. [ 640.940305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-803a836d-5559-4427-8be9-608957b43dff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.947046] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.947742] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.947742] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.947946] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.948151] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.948436] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.368641] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.368822] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.368895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.369141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.369228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.369337] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 178ddec7-80de-4f00-8a79-ec3131cc1df5 already deleted. [ 641.369425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-178ddec7-80de-4f00-8a79-ec3131cc1df5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.784020] env[65162]: INFO networking_nsxv3.common.synchronization [req-55a268e0-b554-4e34-a273-f10a79454f52 req-b7206549-cab1-424e-987e-c42e4942feb8 service nova] Enqueued Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_rules [ 641.784020] env[65162]: INFO networking_nsxv3.common.synchronization [req-55a268e0-b554-4e34-a273-f10a79454f52 req-b7206549-cab1-424e-987e-c42e4942feb8 service nova] Enqueued Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_members [ 641.784250] env[65162]: INFO networking_nsxv3.common.synchronization [req-55a268e0-b554-4e34-a273-f10a79454f52 req-b7206549-cab1-424e-987e-c42e4942feb8 service nova] Enqueued Resource ID: 0b286859-bc83-44cd-bc09-78c346d7e469 with Priority: HIGHEST for action port [ 641.784652] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_rules [ 641.784773] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_members [ 641.784944] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b286859-bc83-44cd-bc09-78c346d7e469 with Priority: HIGHEST for action port [ 641.785237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.785672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.785672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.785784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.785825] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.788203] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.788203] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.788203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.788203] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.788890] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b286859-bc83-44cd-bc09-78c346d7e469 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.789191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.789191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.789309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.789309] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b286859-bc83-44cd-bc09-78c346d7e469',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.295029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.295029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.295029] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.295029] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b286859-bc83-44cd-bc09-78c346d7e469 with status ACTIVE [ 642.295029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.295029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.295029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.295029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.295029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.295029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.295900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.295900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.295900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.295900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.301588] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.301588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.301588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.301815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.301850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.302849] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b286859-bc83-44cd-bc09-78c346d7e469 is going to be updated. [ 642.331442] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.331442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.331442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.331442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.331442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.331442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b286859-bc83-44cd-bc09-78c346d7e469" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.357024] env[65162]: INFO networking_nsxv3.common.synchronization [req-b80e1bae-236f-4fbe-8f28-00ebd30863ca req-cd849189-f131-499e-9a57-0033ba78d064 tempest-ServerDiagnosticsTest-1105926002 tempest-ServerDiagnosticsTest-1105926002-project-member] Enqueued Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_members [ 642.357024] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGHEST for action security_group_members [ 642.357024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.357024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.357024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.358225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.358625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.358931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.359169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.359497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.360976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.360976] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.719028] env[65162]: INFO networking_nsxv3.common.synchronization [req-29cae59a-3181-46f1-a910-9264df154ad3 req-c311a08a-f8b0-49bc-8cdd-468273627a16 tempest-ServersWithSpecificFlavorTestJSON-515804645 tempest-ServersWithSpecificFlavorTestJSON-515804645-project-member] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 642.720017] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 642.720466] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.720599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.720661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.720950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.721085] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.721265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.721265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.721406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.721471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.722498] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.805219] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.861968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.862182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.862370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.862484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.862611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.862759] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.862853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.862913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.863110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.863199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.863285] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 is going to be updated. [ 642.899272] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.899415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.899482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.899695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.900808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.910296] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 in Status: IN_PROGRESS for 2s [ 643.185971] env[65162]: INFO networking_nsxv3.common.synchronization [None req-dfc64879-db36-4c43-9b56-bb1097181a95 None None] Enqueued Resource ID: 429b0728-c6e7-4514-9728-97942b7e1fcf with Priority: HIGHEST for action port [ 643.185971] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429b0728-c6e7-4514-9728-97942b7e1fcf with Priority: HIGHEST for action port [ 643.185971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-429b0728-c6e7-4514-9728-97942b7e1fcf taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.185971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429b0728-c6e7-4514-9728-97942b7e1fcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.185971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429b0728-c6e7-4514-9728-97942b7e1fcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.186458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429b0728-c6e7-4514-9728-97942b7e1fcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.186458] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429b0728-c6e7-4514-9728-97942b7e1fcf',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.211301] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.211577] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.211676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.212077] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.212223] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.212409] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.212532] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.212772] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.212925] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.213199] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.213332] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.213434] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.213544] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.213659] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.213767] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.213906] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.226802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.227018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.227112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.227329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.227443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.227644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.227759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.227831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.228018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.228130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.228217] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db already deleted. [ 643.228400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.236672] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.236908] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.237221] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.237368] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.237788] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-a45ffc70-4a0b-4241-a12f-fb291c1849e3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.238245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.238245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.238636] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.238868] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45ffc70-4a0b-4241-a12f-fb291c1849e3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.308424] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.308872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.308872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.308987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.309348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.309348] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f86c44d7-d532-4841-9243-c4031dd1f02d is going to be created. [ 643.339829] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.340057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.340237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.340303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.340524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.352820] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f86c44d7-d532-4841-9243-c4031dd1f02d in Status: UNINITIALIZED for 2s [ 643.689881] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 429b0728-c6e7-4514-9728-97942b7e1fcf [ 643.690220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.690437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.690537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.690927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.691141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.691269] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:429b0728-c6e7-4514-9728-97942b7e1fcf already deleted. [ 643.691377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429b0728-c6e7-4514-9728-97942b7e1fcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.741292] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.741514] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.741661] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.741916] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.742092] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.742227] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port a45ffc70-4a0b-4241-a12f-fb291c1849e3 not found, creating... [ 643.743202] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.743432] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.743683] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.743969] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.744134] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.744443] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.744708] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.744769] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.744998] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.745248] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.745455] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: a45ffc70-4a0b-4241-a12f-fb291c1849e3 is going to be created. [ 643.769194] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.769438] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.769582] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.769863] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.770182] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.770375] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.522798] env[65162]: INFO networking_nsxv3.common.synchronization [req-29cae59a-3181-46f1-a910-9264df154ad3 req-207a352d-8f5d-4b2a-a032-a810d2d68520 service nova] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 644.523172] env[65162]: INFO networking_nsxv3.common.synchronization [req-29cae59a-3181-46f1-a910-9264df154ad3 req-207a352d-8f5d-4b2a-a032-a810d2d68520 service nova] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 644.523172] env[65162]: INFO networking_nsxv3.common.synchronization [req-29cae59a-3181-46f1-a910-9264df154ad3 req-207a352d-8f5d-4b2a-a032-a810d2d68520 service nova] Enqueued Resource ID: a45ffc70-4a0b-4241-a12f-fb291c1849e3 with Priority: HIGHEST for action port [ 644.523606] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 644.523737] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 644.523977] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a45ffc70-4a0b-4241-a12f-fb291c1849e3 with Priority: HIGHEST for action port [ 644.524134] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.524372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.524372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.524537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.524685] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.526045] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.526045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.526179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.526270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.526423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.526517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.526585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.526715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.526792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.527386] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.528254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a45ffc70-4a0b-4241-a12f-fb291c1849e3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.528254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.528254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.528254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.528254] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45ffc70-4a0b-4241-a12f-fb291c1849e3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.930164] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 in Status: SUCCESS [ 644.930164] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 deletion is rescheduled due to dependency. [ 644.930164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.956190] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5769486-a434-4aad-b29b-f7f8a76f7766 req-7bee7d50-745c-4a4e-bc46-d893281310f3 tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 644.956190] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 644.956190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.956190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.956190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.956190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.956190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.956190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.956190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.957348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.957615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.959125] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.029741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.029956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.030235] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.033294] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a45ffc70-4a0b-4241-a12f-fb291c1849e3 with status ACTIVE [ 645.033440] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.033809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.033809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.033886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.033980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.034190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.034382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.034420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.034558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.034654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.034860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.034955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.035029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.035202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.035293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.035419] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a45ffc70-4a0b-4241-a12f-fb291c1849e3 is going to be updated. [ 645.065425] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.066123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.066350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.066813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.066871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.067120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a45ffc70-4a0b-4241-a12f-fb291c1849e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.364455] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f86c44d7-d532-4841-9243-c4031dd1f02d in Status: SUCCESS [ 645.364603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.364742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.364953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.365152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.365268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.365332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.365484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.365561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.365661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.365750] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.460795] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.461073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.461073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.461336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.461437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.461631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.461740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.461799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.462020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.462240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.462240] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 already deleted. [ 645.462357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.533090] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.557559] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.557804] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.558077] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.558378] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.558642] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.558806] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.559269] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.559531] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.559679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.559913] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.560060] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.560172] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.560279] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.560391] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.560492] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.560719] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.588901] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.589122] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.589197] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.589820] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.589820] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-0d82a288-dd91-4bac-92af-3d14d80d584e taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.590053] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.590098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.590490] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.590553] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d82a288-dd91-4bac-92af-3d14d80d584e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.868350] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.869240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.869240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.869240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.869438] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.869501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.869634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.869836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.869836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.870065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.870065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.870260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.870260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.870398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.870632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.870632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.870632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.870850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.870850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.870944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.870986] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.036070] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.036244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.036318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.036538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.036628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.036723] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be created. [ 646.059730] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.059730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.059993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.060050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.062661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.074152] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: UNINITIALIZED for 2s [ 646.096018] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.096018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.096018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.096018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.096018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.096740] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 0d82a288-dd91-4bac-92af-3d14d80d584e not found, creating... [ 646.096740] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.096740] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.096740] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.096986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.096986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.097213] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.097386] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.097443] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.097625] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.097755] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.097888] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 0d82a288-dd91-4bac-92af-3d14d80d584e is going to be created. [ 646.124691] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.124902] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.125034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.125303] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.126290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.126290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.376317] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f86c44d7-d532-4841-9243-c4031dd1f02d: rpc.has_security_group_logging(os_id): False [ 646.401159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.401159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.401450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.402458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.402458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.402458] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.402458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.402458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.402458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.402458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.402839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.402839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.402839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.403563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.403563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.403563] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.403563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.403563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.403814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.403814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.403884] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f86c44d7-d532-4841-9243-c4031dd1f02d is going to be created. [ 646.495088] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.495288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.495342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.495569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.495754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.512123] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f86c44d7-d532-4841-9243-c4031dd1f02d in Status: IN_PROGRESS for 2s [ 646.898805] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5769486-a434-4aad-b29b-f7f8a76f7766 req-c0f44ca4-9283-48c3-b307-2ed911088a07 service nova] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_rules [ 646.899059] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5769486-a434-4aad-b29b-f7f8a76f7766 req-c0f44ca4-9283-48c3-b307-2ed911088a07 service nova] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 646.899097] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5769486-a434-4aad-b29b-f7f8a76f7766 req-c0f44ca4-9283-48c3-b307-2ed911088a07 service nova] Enqueued Resource ID: 0d82a288-dd91-4bac-92af-3d14d80d584e with Priority: HIGHEST for action port [ 646.900267] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_rules [ 646.900712] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 646.900712] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d82a288-dd91-4bac-92af-3d14d80d584e with Priority: HIGHEST for action port [ 646.900816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.900945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.901038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.901310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.901458] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.902621] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.902753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.902823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.903195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.903230] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.904500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.904758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.904856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.905249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.905249] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.905986] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d82a288-dd91-4bac-92af-3d14d80d584e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.906114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.906183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.906356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.906461] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d82a288-dd91-4bac-92af-3d14d80d584e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.408334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.410043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.410043] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.410236] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d82a288-dd91-4bac-92af-3d14d80d584e with status ACTIVE [ 647.411478] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.411478] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.411478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.412082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.412160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.412261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.412447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.412628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.412748] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d82a288-dd91-4bac-92af-3d14d80d584e is going to be updated. [ 647.440757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.441017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.441134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.441554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.441808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.442094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d82a288-dd91-4bac-92af-3d14d80d584e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.690662] env[65162]: INFO networking_nsxv3.common.synchronization [req-24c5ef8a-9b9b-4bbe-98ba-03f3bf3722d5 req-e04b20d1-5ec0-44cb-b98d-996f8c9d94e1 tempest-ImagesNegativeTestJSON-294442213 tempest-ImagesNegativeTestJSON-294442213-project-member] Enqueued Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_members [ 647.691332] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_members [ 647.691530] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.691658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.691718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.691998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.692164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.692268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.692332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.692488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.692575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.692670] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.917406] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.085150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 648.085375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.085570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.085794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.085989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.086285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.086285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.086618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.086618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.086618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.086618] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.121594] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.123368] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-774" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.123852] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-774" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.124344] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-774" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.125176] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.125419] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.125565] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.125839] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.126125] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.126387] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.126682] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.126878] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.127031] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.127173] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.127302] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.127454] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.147213] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.147385] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.147519] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.147699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-774" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.148133] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-b91d893d-e241-46a0-afad-dd778ea5d7c9 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.148316] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.148465] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.148815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.148952] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b91d893d-e241-46a0-afad-dd778ea5d7c9',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.199323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.199323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.199323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd94e034-7289-4a18-8431-d4bba42b0823 already deleted. [ 648.199323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.420033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.420202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.420345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.420684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.420856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.421019] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be created. [ 648.451376] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.451600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.452205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.452205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.452205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.465071] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: UNINITIALIZED for 2s [ 648.524634] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f86c44d7-d532-4841-9243-c4031dd1f02d in Status: SUCCESS [ 648.524935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.588747] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.652458] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.652670] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.652821] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.653218] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.653464] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.653702] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port b91d893d-e241-46a0-afad-dd778ea5d7c9 not found, creating... [ 648.654214] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.654451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.654653] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.655052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.655187] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.655572] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.655745] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.655887] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.656136] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.656281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.656432] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: b91d893d-e241-46a0-afad-dd778ea5d7c9 is going to be created. [ 648.685045] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.685335] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.686459] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.686459] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.686459] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.686459] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.901522] env[65162]: INFO networking_nsxv3.common.synchronization [req-d34eea6c-f460-4d85-8b97-8dde2318a543 req-d491dae6-4d17-4b74-a0ad-2fb165598af2 tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 0441b20f-b8db-4696-ba3b-5b0d61099e0b with Priority: HIGHEST for action security_group_rules [ 648.901599] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0441b20f-b8db-4696-ba3b-5b0d61099e0b with Priority: HIGHEST for action security_group_rules [ 648.901874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0441b20f-b8db-4696-ba3b-5b0d61099e0b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.901996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0441b20f-b8db-4696-ba3b-5b0d61099e0b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.902074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0441b20f-b8db-4696-ba3b-5b0d61099e0b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.902330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0441b20f-b8db-4696-ba3b-5b0d61099e0b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.902409] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0441b20f-b8db-4696-ba3b-5b0d61099e0b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.039882] env[65162]: INFO networking_nsxv3.common.synchronization [req-a29fc71f-5a51-47ea-9d8b-66668d596a36 req-648229f9-3ed3-4631-8e2b-83c97b7bd1d7 tempest-SecurityGroupRulesNegativeTestJSON-477747221 tempest-SecurityGroupRulesNegativeTestJSON-477747221-project-member] Enqueued Resource ID: f02008f0-dc2f-44fc-aa7f-65764f57d83d with Priority: HIGHEST for action security_group_rules [ 649.040464] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f02008f0-dc2f-44fc-aa7f-65764f57d83d with Priority: HIGHEST for action security_group_rules [ 649.040780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.040899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.040965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.041466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.041551] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f02008f0-dc2f-44fc-aa7f-65764f57d83d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.091393] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6661d9a-0a2f-4ad7-a804-9e5004aa95db: rpc.has_security_group_logging(os_id): False [ 649.106862] env[65162]: INFO networking_nsxv3.common.synchronization [None req-898c2442-391e-43d3-b6d1-0535183b7d58 None None] Enqueued Resource ID: 599459f7-5fcf-48d4-ada2-95eca830684e with Priority: HIGHEST for action port [ 649.107060] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599459f7-5fcf-48d4-ada2-95eca830684e with Priority: HIGHEST for action port [ 649.114026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-599459f7-5fcf-48d4-ada2-95eca830684e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-599459f7-5fcf-48d4-ada2-95eca830684e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-599459f7-5fcf-48d4-ada2-95eca830684e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-599459f7-5fcf-48d4-ada2-95eca830684e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.114026] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('599459f7-5fcf-48d4-ada2-95eca830684e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.114026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.114026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.114026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.114026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be created. [ 649.176270] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.176459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.176535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.176750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.176936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.191062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 649.436872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.437040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.437112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.437358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.437454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.437552] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0441b20f-b8db-4696-ba3b-5b0d61099e0b already deleted. [ 649.437639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0441b20f-b8db-4696-ba3b-5b0d61099e0b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.567845] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.568011] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.568086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.568316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.568548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.568548] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f02008f0-dc2f-44fc-aa7f-65764f57d83d already deleted. [ 649.568643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.588401] env[65162]: INFO networking_nsxv3.common.synchronization [req-24c5ef8a-9b9b-4bbe-98ba-03f3bf3722d5 req-cf50cca5-dbac-469a-af91-8c20da39e2fe service nova] Enqueued Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_rules [ 649.588401] env[65162]: INFO networking_nsxv3.common.synchronization [req-24c5ef8a-9b9b-4bbe-98ba-03f3bf3722d5 req-cf50cca5-dbac-469a-af91-8c20da39e2fe service nova] Enqueued Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_members [ 649.588401] env[65162]: INFO networking_nsxv3.common.synchronization [req-24c5ef8a-9b9b-4bbe-98ba-03f3bf3722d5 req-cf50cca5-dbac-469a-af91-8c20da39e2fe service nova] Enqueued Resource ID: b91d893d-e241-46a0-afad-dd778ea5d7c9 with Priority: HIGHEST for action port [ 649.588401] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_rules [ 649.588401] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_members [ 649.588401] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b91d893d-e241-46a0-afad-dd778ea5d7c9 with Priority: HIGHEST for action port [ 649.588728] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.588728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.588728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.589035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.589073] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.589912] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.590044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.590111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.590288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.590481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.590551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.590593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.590832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.590832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.590967] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.592243] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b91d893d-e241-46a0-afad-dd778ea5d7c9 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.592356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.592399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.592581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.592646] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b91d893d-e241-46a0-afad-dd778ea5d7c9',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.611946] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 599459f7-5fcf-48d4-ada2-95eca830684e [ 649.612232] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.612373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.612445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.612834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.612834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.612906] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:599459f7-5fcf-48d4-ada2-95eca830684e already deleted. [ 649.612945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-599459f7-5fcf-48d4-ada2-95eca830684e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.897123] env[65162]: INFO networking_nsxv3.common.synchronization [req-afac2651-36d9-4a85-a475-f584d9b5884f req-d6ad2e84-885b-4f48-8d41-b7e04ed4cb00 tempest-TenantUsagesTestJSON-1896945488 tempest-TenantUsagesTestJSON-1896945488-project-member] Enqueued Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_members [ 649.897123] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_members [ 649.897123] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.897123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.897123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.897427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.897427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.897573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.897618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.897791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.897878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.897973] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.098529] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.100439] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.100439] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.100439] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b91d893d-e241-46a0-afad-dd778ea5d7c9 with status ACTIVE [ 650.103683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.103683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.103683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.104882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.105370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.105476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.105704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.105800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.105924] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b91d893d-e241-46a0-afad-dd778ea5d7c9 is going to be updated. [ 650.136314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.136314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.136716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.136716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.136836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.137015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b91d893d-e241-46a0-afad-dd778ea5d7c9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.400569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.400732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.400796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.404022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.404022] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0acf84-468d-4a9a-80be-4595d495629a already deleted. [ 650.404022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.480972] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 650.481204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.481381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.481626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.482109] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.482109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.482109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.482438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.482438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.482438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.482575] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.538428] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.538428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.538428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.538428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.538428] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.538428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.538428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.542512] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.543583] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.543583] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.543583] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.543583] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.543824] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.543824] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.543824] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.544712] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.564368] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.564571] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.564801] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.565028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.565389] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.565746] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.565925] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.566629] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.566902] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e6e5ab3-15fa-41a2-aae6-97f7e082925c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.608458] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.985288] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.985510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.985510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.985829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.985918] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.985998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.986083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.986553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.986553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.986553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.986774] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.986838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.987128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.987358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.987524] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.987621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.987682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.987831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.987978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.988273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.988400] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.071492] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.073937] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 9e6e5ab3-15fa-41a2-aae6-97f7e082925c not found, creating... [ 651.073937] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.073937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.075703] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.075703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.075703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.075703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.075703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.075703] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 9e6e5ab3-15fa-41a2-aae6-97f7e082925c is going to be created. [ 651.096692] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.097511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.097511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.097802] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.098288] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.099111] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.110611] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.110801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.110884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.111526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.111526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.111694] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd94e034-7289-4a18-8431-d4bba42b0823 is going to be created. [ 651.172759] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.173100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.173100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.173309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.173494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.188244] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd94e034-7289-4a18-8431-d4bba42b0823 in Status: UNINITIALIZED for 2s [ 651.203671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 651.203943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.429037] env[65162]: INFO networking_nsxv3.common.synchronization [None req-eb82f693-466b-46fd-b9b2-78a171677158 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 651.429631] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 651.429900] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.430304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.430550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.430849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.431257] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.491881] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2880f64-bee4-45fb-88ef-a60ad0c676d2: rpc.has_security_group_logging(os_id): False [ 651.515801] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.516024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.516072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.516268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.516369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.516568] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.516684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.516746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.516869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.516974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.517153] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.517249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.517311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.517452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.517528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.517708] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.517816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.517857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.517986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.518615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.518857] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be created. [ 651.591757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.592024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.592024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.592216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.592401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.605089] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 651.635707] env[65162]: INFO networking_nsxv3.common.synchronization [None req-43177330-3a9d-4e4b-aad5-b97fecb5f3f3 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 651.636324] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 651.636691] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.637096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.867731] env[65162]: INFO networking_nsxv3.common.synchronization [req-afac2651-36d9-4a85-a475-f584d9b5884f req-c61770df-baf3-471f-a092-f23ef5180bc0 service nova] Enqueued Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_rules [ 651.867903] env[65162]: INFO networking_nsxv3.common.synchronization [req-afac2651-36d9-4a85-a475-f584d9b5884f req-c61770df-baf3-471f-a092-f23ef5180bc0 service nova] Enqueued Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_members [ 651.868019] env[65162]: INFO networking_nsxv3.common.synchronization [req-afac2651-36d9-4a85-a475-f584d9b5884f req-c61770df-baf3-471f-a092-f23ef5180bc0 service nova] Enqueued Resource ID: 9e6e5ab3-15fa-41a2-aae6-97f7e082925c with Priority: HIGHEST for action port [ 651.868325] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_rules [ 651.868478] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_members [ 651.868559] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e6e5ab3-15fa-41a2-aae6-97f7e082925c with Priority: HIGHEST for action port [ 651.870633] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.870633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.870633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.871055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.871055] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.871961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.872496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.872496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.872496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.872496] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.872762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.872762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.872836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.872880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.872943] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.875956] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.875956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.875956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.875956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.875956] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e6e5ab3-15fa-41a2-aae6-97f7e082925c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.953548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.953886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.953886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.954358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.954472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.954564] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb already deleted. [ 651.954609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.954837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.955295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.955414] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.379721] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.380062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.382679] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e6e5ab3-15fa-41a2-aae6-97f7e082925c with status ACTIVE [ 652.387491] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.387491] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.387491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.388077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.388077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.388077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.389728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.390186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.390186] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e6e5ab3-15fa-41a2-aae6-97f7e082925c is going to be updated. [ 652.393073] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.426319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.426651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.426651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.426918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.426980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.427217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e6e5ab3-15fa-41a2-aae6-97f7e082925c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.478103] env[65162]: INFO networking_nsxv3.common.synchronization [None req-2d4536e3-4b9a-4d83-9b8f-14123ada8f83 None None] Enqueued Resource ID: b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64 with Priority: HIGHEST for action port [ 652.478993] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64 with Priority: HIGHEST for action port [ 652.479388] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.480375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.480375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.480375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.480375] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.485397] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.485397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.485397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.485397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.485397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.485397] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb already deleted. [ 652.485397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.897826] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.986252] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64 [ 652.986515] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.986686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.986686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.986924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.987026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.987128] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64 already deleted. [ 652.987215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7166ef5-7d3b-4b48-b2bf-ecabbd1f1e64" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.136551] env[65162]: INFO networking_nsxv3.common.synchronization [req-9042acae-7a81-4037-a4b4-8b412641f4ae req-9ade375c-b9eb-4d5d-b650-41d0e1eb5acf tempest-SecurityGroupRulesNegativeTestJSON-477747221 tempest-SecurityGroupRulesNegativeTestJSON-477747221-project-member] Enqueued Resource ID: f02008f0-dc2f-44fc-aa7f-65764f57d83d with Priority: HIGHEST for action security_group_rules [ 653.142410] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f02008f0-dc2f-44fc-aa7f-65764f57d83d with Priority: HIGHEST for action security_group_rules [ 653.146134] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.146134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.146134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.146134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.146134] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f02008f0-dc2f-44fc-aa7f-65764f57d83d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.202581] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd94e034-7289-4a18-8431-d4bba42b0823 in Status: SUCCESS [ 653.203109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.205239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.205629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.205870] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.206077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.206183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.206456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.206611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.206767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.206895] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.402806] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.402806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.402806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.402806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.402806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.402806] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0acf84-468d-4a9a-80be-4595d495629a is going to be created. [ 653.432039] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.432039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.432039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.432039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.432039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.446278] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0acf84-468d-4a9a-80be-4595d495629a in Status: UNINITIALIZED for 2s [ 653.624969] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 653.624969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.677250] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.677250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.677250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.677809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.678225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.678999] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f02008f0-dc2f-44fc-aa7f-65764f57d83d already deleted. [ 653.679341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f02008f0-dc2f-44fc-aa7f-65764f57d83d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.715343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.715343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.715343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.715343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.715343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.719840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.719840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.719840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.719840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.719840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.719840] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.967358] env[65162]: INFO networking_nsxv3.common.synchronization [req-694b4a0c-66f5-4aad-9549-019f94b1d746 req-9e455329-f49d-4d70-9e14-534887d95f57 tempest-ServerPasswordTestJSON-330434700 tempest-ServerPasswordTestJSON-330434700-project-member] Enqueued Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_members [ 653.968470] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 with Priority: HIGHEST for action security_group_members [ 653.969491] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.970347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.972527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.972527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.972527] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.972527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.972527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.972527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.972527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.972527] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b521adf-a3c4-47a4-a31d-e406ca77ccb7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.222417] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd94e034-7289-4a18-8431-d4bba42b0823: rpc.has_security_group_logging(os_id): False [ 654.244488] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.244774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.244774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.244930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.245042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.245274] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.245422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.245529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.245769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.245898] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.246204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.246399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.246516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.246742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.246859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.247837] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.247987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.248103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.248279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.248366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.248466] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd94e034-7289-4a18-8431-d4bba42b0823 is going to be created. [ 654.351127] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.351466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.351466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.351760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.352084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.372590] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd94e034-7289-4a18-8431-d4bba42b0823 in Status: IN_PROGRESS for 2s [ 654.477662] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.482126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.482126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.482421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.482601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.482932] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.483067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.483067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.483282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.483399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.483461] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 is going to be updated. [ 654.540089] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.540254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.540319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.542834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.542834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.554306] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 in Status: IN_PROGRESS for 2s [ 654.934168] env[65162]: INFO networking_nsxv3.common.synchronization [req-684af872-0f79-4baf-af59-83ecef3eec18 req-ec320057-6228-48e5-ba77-2442b963b71a tempest-FloatingIPsAssociationTestJSON-1766689371 tempest-FloatingIPsAssociationTestJSON-1766689371-project-member] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 654.934890] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 654.935366] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.935521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.935632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.935910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.937026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.937235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.937310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.937552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.937670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.937784] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.260600] env[65162]: INFO networking_nsxv3.common.synchronization [req-1ef0d426-e4fe-433a-be8b-40a3ec1e16ee req-becc8be9-5ede-44fc-81fd-3eb57ee6a960 tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 2eab78df-9c81-44c9-91e8-19cd327092e9 with Priority: HIGHEST for action security_group_rules [ 655.261172] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eab78df-9c81-44c9-91e8-19cd327092e9 with Priority: HIGHEST for action security_group_rules [ 655.261500] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eab78df-9c81-44c9-91e8-19cd327092e9 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.261636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eab78df-9c81-44c9-91e8-19cd327092e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.261710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eab78df-9c81-44c9-91e8-19cd327092e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.261944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eab78df-9c81-44c9-91e8-19cd327092e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.263140] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eab78df-9c81-44c9-91e8-19cd327092e9',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.440194] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.458400] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0acf84-468d-4a9a-80be-4595d495629a in Status: SUCCESS [ 655.458697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.458886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.459303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.459409] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.459547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.459591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.459766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.459890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.460031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.460155] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.508714] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-724 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.509164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.509164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.509537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.509922] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.510165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.510408] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.510704] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.510928] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.511646] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.511807] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.511947] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.512105] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.512373] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.512598] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.512739] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.545617] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.545843] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.545940] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.547036] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-724" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.547036] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.547036] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.547036] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.547036] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.547373] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7b6d17f-cbff-4a0c-8a20-5c59c0e473df',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.788251] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.788411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.788462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.788677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.788769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.788863] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eab78df-9c81-44c9-91e8-19cd327092e9 already deleted. [ 655.788952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eab78df-9c81-44c9-91e8-19cd327092e9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.945427] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.967632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.967791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.967840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.968144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.968328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.968454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.968505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.968667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.968752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.968882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.969030] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.969159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.969941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.970220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.970378] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.970505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.970571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.970782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.970860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.970949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.971134] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.050384] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.050584] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.050584] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.050853] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.052090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.052090] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port f7b6d17f-cbff-4a0c-8a20-5c59c0e473df not found, creating... [ 656.052090] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.052090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.052090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.052090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.052090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.052664] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.052664] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.052779] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.052896] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.053030] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.053162] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: f7b6d17f-cbff-4a0c-8a20-5c59c0e473df is going to be created. [ 656.084022] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.084022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.084022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.084022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.084022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.084022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.388819] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd94e034-7289-4a18-8431-d4bba42b0823 in Status: SUCCESS [ 656.389175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.448122] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.448386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.448513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.448822] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.448980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.449157] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be updated. [ 656.474413] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec0acf84-468d-4a9a-80be-4595d495629a: rpc.has_security_group_logging(os_id): False [ 656.490349] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.490349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.490349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.490349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.490765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.501323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.501579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.501641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.501955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.502055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.502367] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.502470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.502531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.502696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.502777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.502951] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.503076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.503159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.503410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.503654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.503979] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.504157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.504241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.504413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.504501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.504589] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec0acf84-468d-4a9a-80be-4595d495629a is going to be created. [ 656.506850] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: IN_PROGRESS for 2s [ 656.568667] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 in Status: SUCCESS [ 656.569387] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b521adf-a3c4-47a4-a31d-e406ca77ccb7 deletion is rescheduled due to dependency. [ 656.569824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b521adf-a3c4-47a4-a31d-e406ca77ccb7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.582062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.582241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.582298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.582496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.582789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.600233] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec0acf84-468d-4a9a-80be-4595d495629a in Status: IN_PROGRESS for 2s [ 656.865190] env[65162]: INFO networking_nsxv3.common.synchronization [req-684af872-0f79-4baf-af59-83ecef3eec18 req-4b92fd54-49f0-44b8-a782-e5550673c24e service nova] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_rules [ 656.865190] env[65162]: INFO networking_nsxv3.common.synchronization [req-684af872-0f79-4baf-af59-83ecef3eec18 req-4b92fd54-49f0-44b8-a782-e5550673c24e service nova] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 656.865190] env[65162]: INFO networking_nsxv3.common.synchronization [req-684af872-0f79-4baf-af59-83ecef3eec18 req-4b92fd54-49f0-44b8-a782-e5550673c24e service nova] Enqueued Resource ID: f7b6d17f-cbff-4a0c-8a20-5c59c0e473df with Priority: HIGHEST for action port [ 656.866626] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_rules [ 656.870046] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 656.870046] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7b6d17f-cbff-4a0c-8a20-5c59c0e473df with Priority: HIGHEST for action port [ 656.870046] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.870046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.870046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.870046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.870046] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.870996] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.874717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.874717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.874717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.874717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.874717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.874717] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7b6d17f-cbff-4a0c-8a20-5c59c0e473df',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.082759] env[65162]: INFO networking_nsxv3.common.synchronization [req-98316768-63a5-4ff2-aea8-b5c320681d0b req-70b74eaa-c919-4270-95d9-5e3a98dadb7e tempest-ServerExternalEventsTest-958800395 tempest-ServerExternalEventsTest-958800395-project-member] Enqueued Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_members [ 657.083486] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGHEST for action security_group_members [ 657.083833] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.083954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.084092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.084634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.084823] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.084958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.085052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.085250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.085362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.085556] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.375862] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.375999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.376195] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7b6d17f-cbff-4a0c-8a20-5c59c0e473df with status ACTIVE [ 657.376360] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.376468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.376533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.376752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.376836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.377016] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.377121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.377184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.377338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.377418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.378464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.378464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.378620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.378701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.378781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.379134] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7b6d17f-cbff-4a0c-8a20-5c59c0e473df is going to be updated. [ 657.403869] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.404111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.404258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.404567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.404780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.405025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7b6d17f-cbff-4a0c-8a20-5c59c0e473df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.588370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.588993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.588993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.588993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.588993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.589205] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.589279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.589369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.589591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.589707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.589807] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f86c44d7-d532-4841-9243-c4031dd1f02d is going to be updated. [ 657.644852] env[65162]: INFO networking_nsxv3.common.synchronization [req-5323d6d5-e4b5-4f39-aa4c-9b340ddf182b req-311a2ab3-23db-46d1-846a-9f4780b8cf6e tempest-DeleteServersAdminTestJSON-500387442 tempest-DeleteServersAdminTestJSON-500387442-project-member] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 657.646215] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 657.646673] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.647713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.647713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.647713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.647713] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.647713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.648029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.648029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.648266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.648324] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.748812] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.748901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.749059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.749296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.752086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.763131] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f86c44d7-d532-4841-9243-c4031dd1f02d in Status: IN_PROGRESS for 2s [ 658.129119] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.130161] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.130161] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.130370] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.130822] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.131244] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.131456] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.131700] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.132050] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.132413] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.132631] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.133263] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.133437] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.133756] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.134796] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.134796] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.150581] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.150886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.150974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.151446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.151605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.151883] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.152098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.152170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.152369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.152478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.152583] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be updated. [ 658.157176] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.157393] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.157505] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.157671] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.158069] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-c0963b6b-b09b-4bfe-99ee-b7c634a80653 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.158256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.158397] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.158753] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.158907] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0963b6b-b09b-4bfe-99ee-b7c634a80653',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.196440] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.196440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.196440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.196440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.196440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.212040] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 2s [ 658.518377] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 658.518600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.518774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.519010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.519202] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.519324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.519391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.519690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.519780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.519884] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.614921] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec0acf84-468d-4a9a-80be-4595d495629a in Status: SUCCESS [ 658.615413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.664070] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.664298] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.664442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.664753] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.664902] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.665146] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port c0963b6b-b09b-4bfe-99ee-b7c634a80653 not found, creating... [ 658.665416] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.665593] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.665719] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.666024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.666094] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.666384] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.666538] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.666648] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.666853] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.666980] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.671385] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: c0963b6b-b09b-4bfe-99ee-b7c634a80653 is going to be created. [ 658.695281] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.695281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.695543] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.695737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.695998] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.696271] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.022321] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.526697] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.622767] env[65162]: INFO networking_nsxv3.common.synchronization [req-5323d6d5-e4b5-4f39-aa4c-9b340ddf182b req-bd811139-4f9f-4167-9d6b-7595fd4528ae service nova] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_rules [ 659.623116] env[65162]: INFO networking_nsxv3.common.synchronization [req-5323d6d5-e4b5-4f39-aa4c-9b340ddf182b req-bd811139-4f9f-4167-9d6b-7595fd4528ae service nova] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 659.623468] env[65162]: INFO networking_nsxv3.common.synchronization [req-5323d6d5-e4b5-4f39-aa4c-9b340ddf182b req-bd811139-4f9f-4167-9d6b-7595fd4528ae service nova] Enqueued Resource ID: c0963b6b-b09b-4bfe-99ee-b7c634a80653 with Priority: HIGHEST for action port [ 659.624955] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_rules [ 659.624955] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 659.624955] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0963b6b-b09b-4bfe-99ee-b7c634a80653 with Priority: HIGHEST for action port [ 659.625373] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.625507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.625602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.626025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.626446] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.632394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.632394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.632394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0963b6b-b09b-4bfe-99ee-b7c634a80653 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.632394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.632394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.632394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.632394] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0963b6b-b09b-4bfe-99ee-b7c634a80653',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.781470] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f86c44d7-d532-4841-9243-c4031dd1f02d in Status: SUCCESS [ 659.781663] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f86c44d7-d532-4841-9243-c4031dd1f02d deletion is rescheduled due to dependency. [ 659.781844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.030283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.030453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.030529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.030764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.030857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.030954] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be updated. [ 660.066573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.067193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.067846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.068345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.069035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.081482] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: IN_PROGRESS for 2s [ 660.133828] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.133828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.133828] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0963b6b-b09b-4bfe-99ee-b7c634a80653 with status ACTIVE [ 660.137773] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.137773] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.137773] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.137773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.137773] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0963b6b-b09b-4bfe-99ee-b7c634a80653 is going to be updated. [ 660.162033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.162216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.162216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.164116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.164116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.164116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0963b6b-b09b-4bfe-99ee-b7c634a80653" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.227779] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 4s [ 660.435727] env[65162]: INFO networking_nsxv3.common.synchronization [req-bdbea37b-3f97-471e-a777-7426fc27d0a6 req-0e1fe461-03db-47d5-8c66-6cfd7ae32304 tempest-ServersTestManualDisk-2035761477 tempest-ServersTestManualDisk-2035761477-project-member] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_members [ 660.436479] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_members [ 660.436813] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.436944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.437035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.437394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.437556] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.437672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.439752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.440039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.442188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.442188] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.895719] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.896141] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-590" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.896141] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-590" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.896452] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-590" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.896684] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.896844] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.897058] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.897507] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.897741] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.898044] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.898575] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.898575] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.898575] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.898731] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.898999] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.899209] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.925294] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.925437] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.925573] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.925811] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-590" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.926162] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-419da953-aa8c-4516-9943-593d2f4f91f8 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.926391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.926575] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.926953] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.927105] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419da953-aa8c-4516-9943-593d2f4f91f8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.943540] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.943849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.943979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.944377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.944586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.944965] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.945146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.945256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.945495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.945616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.945754] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 already deleted. [ 660.945895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.431768] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.432063] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.432227] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.432404] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.432549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.432725] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 419da953-aa8c-4516-9943-593d2f4f91f8 not found, creating... [ 661.432987] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.433616] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.433616] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.433616] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.434154] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.434154] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.434154] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.434565] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.435112] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.435316] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.435517] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 419da953-aa8c-4516-9943-593d2f4f91f8 is going to be created. [ 661.462896] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.463200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.463359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.463652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.463881] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.464125] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.095084] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 662.095609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.095609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.095855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.096137] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.096377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.096462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.096665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.096783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.096878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.097018] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.198341] env[65162]: INFO networking_nsxv3.common.synchronization [req-bdbea37b-3f97-471e-a777-7426fc27d0a6 req-bba6aed8-b247-4cce-bf88-dce78d205097 service nova] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_rules [ 662.198595] env[65162]: INFO networking_nsxv3.common.synchronization [req-bdbea37b-3f97-471e-a777-7426fc27d0a6 req-bba6aed8-b247-4cce-bf88-dce78d205097 service nova] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_members [ 662.198794] env[65162]: INFO networking_nsxv3.common.synchronization [req-bdbea37b-3f97-471e-a777-7426fc27d0a6 req-bba6aed8-b247-4cce-bf88-dce78d205097 service nova] Enqueued Resource ID: 419da953-aa8c-4516-9943-593d2f4f91f8 with Priority: HIGHEST for action port [ 662.199540] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_rules [ 662.199540] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_members [ 662.199709] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 419da953-aa8c-4516-9943-593d2f4f91f8 with Priority: HIGHEST for action port [ 662.201600] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.201826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.201826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.202070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.202924] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.207439] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.209950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.209950] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.209950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-419da953-aa8c-4516-9943-593d2f4f91f8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.209950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.210955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.210955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.210955] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419da953-aa8c-4516-9943-593d2f4f91f8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.239345] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 662.239624] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 deletion is rescheduled due to dependency. [ 662.239745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.240241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.241028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.241028] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.241224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.241224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.242249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.242249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.242249] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.599955] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.600196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.600269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.600491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.600667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.600772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.600831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.600969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.601078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.601274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.601441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.601547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.601609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.601751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.601891] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.601983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.602057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.602192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.602278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.602343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.602474] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.707852] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.708013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.712691] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.714366] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 419da953-aa8c-4516-9943-593d2f4f91f8 with status ACTIVE [ 662.715644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.715644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.715644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.716420] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.716420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.716420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.716420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.716584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.716820] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 419da953-aa8c-4516-9943-593d2f4f91f8 is going to be updated. [ 662.739818] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.739818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.739818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.739818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.739818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.740132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-419da953-aa8c-4516-9943-593d2f4f91f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.746867] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.901976] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c573738-95c3-4956-83ee-decb02f711b4 req-3297f78b-adb1-4993-aa0a-3ea252a44e36 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 662.902542] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 662.902850] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.902972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.903058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.903307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.903455] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.903555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.903618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.903773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.903857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.903952] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.104626] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3335dfc0-bd35-4429-ae08-fe5e4847acff: rpc.has_security_group_logging(os_id): False [ 663.124229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.124478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.124478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.124717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.124828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.125163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.125239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.125830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.125890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.126054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.126130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.126314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.126406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.126460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.126626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.126705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.126796] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be updated. [ 663.193475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.193667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.193745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.194523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.194523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.210951] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: IN_PROGRESS for 2s [ 663.215043] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.249668] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.279197] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.279647] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.279647] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.279911] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.280258] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.280556] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.280823] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.281551] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.281551] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.281808] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.281975] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.282120] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.282360] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.282567] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.282775] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.283014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.312461] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.312990] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.312990] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.313163] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.313579] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.313824] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.313883] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.314235] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.314368] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e212636a-a0cd-4bbb-a279-4a09c8e79e9b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.406172] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.717629] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.717830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.717905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.718161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.718287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.718369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 is going to be created. [ 663.746467] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.746467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.746467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.746467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.746467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.754126] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.754126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.754126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.754126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.754126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.754126] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be updated. [ 663.755932] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 in Status: UNINITIALIZED for 2s [ 663.787518] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.787518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.787518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.787518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.787518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.798355] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 2s [ 663.818256] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.818256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.818256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.818256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.818256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.818256] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port e212636a-a0cd-4bbb-a279-4a09c8e79e9b not found, creating... [ 663.818553] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.820562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.820562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.820562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.820562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.820562] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.820562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.820562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.822284] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.822493] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.822700] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: e212636a-a0cd-4bbb-a279-4a09c8e79e9b is going to be created. [ 663.849398] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.849398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.849398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.849398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.849398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.850000] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.910162] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.343383] env[65162]: INFO networking_nsxv3.common.synchronization [req-6f4b658c-b12f-465f-8224-3d016027e119 req-62d16ef0-5da8-4e26-8db0-5c1835e02323 tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 74f7280a-9564-4c2b-b75a-7273b59f78d0 with Priority: HIGHEST for action security_group_rules [ 664.345605] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7280a-9564-4c2b-b75a-7273b59f78d0 with Priority: HIGHEST for action security_group_rules [ 664.345605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f7280a-9564-4c2b-b75a-7273b59f78d0 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.345605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f7280a-9564-4c2b-b75a-7273b59f78d0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.345605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f7280a-9564-4c2b-b75a-7273b59f78d0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.345605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f7280a-9564-4c2b-b75a-7273b59f78d0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.345605] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f7280a-9564-4c2b-b75a-7273b59f78d0',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.417708] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.417708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.417708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.417708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.417708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.417708] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 664.450416] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.450574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.450744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.451493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.451986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.465312] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 664.637859] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c573738-95c3-4956-83ee-decb02f711b4 req-5c2b4efb-a8ac-42c7-b24d-217856a95646 service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 664.638106] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c573738-95c3-4956-83ee-decb02f711b4 req-5c2b4efb-a8ac-42c7-b24d-217856a95646 service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 664.638204] env[65162]: INFO networking_nsxv3.common.synchronization [req-1c573738-95c3-4956-83ee-decb02f711b4 req-5c2b4efb-a8ac-42c7-b24d-217856a95646 service nova] Enqueued Resource ID: e212636a-a0cd-4bbb-a279-4a09c8e79e9b with Priority: HIGHEST for action port [ 664.638742] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 664.638877] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 664.639228] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e212636a-a0cd-4bbb-a279-4a09c8e79e9b with Priority: HIGHEST for action port [ 664.639523] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.641076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.641076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.641076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.641076] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.641076] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.641076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.641473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.641473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.641473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.641655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.641695] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e212636a-a0cd-4bbb-a279-4a09c8e79e9b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.883014] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.883014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.883014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.883014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.883014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.883014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f7280a-9564-4c2b-b75a-7273b59f78d0 already deleted. [ 664.883014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f7280a-9564-4c2b-b75a-7273b59f78d0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.143564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.143725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.145751] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e212636a-a0cd-4bbb-a279-4a09c8e79e9b with status ACTIVE [ 665.145751] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.145751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.145751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.145751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.145751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.145751] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.145751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.145751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.146355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.146355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.146355] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.146355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.146568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.146568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.146661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.146713] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e212636a-a0cd-4bbb-a279-4a09c8e79e9b is going to be updated. [ 665.177108] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.177418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.177418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.177616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.177689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.177842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e212636a-a0cd-4bbb-a279-4a09c8e79e9b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.233666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 665.233666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.388939] env[65162]: INFO networking_nsxv3.common.synchronization [req-35ef7999-8f63-45d4-82d1-64fddeaab046 req-c6c84a55-e327-4bd8-8120-bcc5e389dabc tempest-ImagesNegativeTestJSON-294442213 tempest-ImagesNegativeTestJSON-294442213-project-member] Enqueued Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_members [ 665.388939] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd94e034-7289-4a18-8431-d4bba42b0823 with Priority: HIGHEST for action security_group_members [ 665.389775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd94e034-7289-4a18-8431-d4bba42b0823 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.389775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.389775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.390044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.390209] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.390348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.390492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.390567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.390654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.390756] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd94e034-7289-4a18-8431-d4bba42b0823',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.767156] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 in Status: SUCCESS [ 665.767156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.767156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.767156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.767541] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.769553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.769553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.769777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.770154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.770154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.770154] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.812504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 665.812738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.813373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.813373] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.813534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.813584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.813713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.813797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.813880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.813988] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.896525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.896703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.896785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.897037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.897128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.897320] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.897421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.897521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.897645] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.897725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.898127] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd94e034-7289-4a18-8431-d4bba42b0823 is going to be updated. [ 665.932154] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.933155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.933155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.933530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.935045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.945167] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd94e034-7289-4a18-8431-d4bba42b0823 in Status: IN_PROGRESS for 2s [ 666.276878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.317299] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.317512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.317597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.317824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.317991] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.318111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.318187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.318546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.318546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.318546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.318853] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.318853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.318853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.319023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.319093] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.319157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.319800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.319800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.319800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.319800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.319800] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.477654] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 666.478182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.478182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.479107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.479107] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.479107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.479107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.479107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.479107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.479428] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.778659] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd3c00c-bea5-4be8-872a-a7b4027d6035: rpc.has_security_group_logging(os_id): False [ 666.801657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.801866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.801866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.802104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.802201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.802458] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.802564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.802635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.802801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.802922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.802997] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 is going to be created. [ 666.823937] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 523df74a-7dca-4c8d-a869-891ca0abbe71: rpc.has_security_group_logging(os_id): False [ 666.848174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.848424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.848484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.848675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.848783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.848976] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.849098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.849162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.849321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.849455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.849779] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.849779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.849779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.853363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.853478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.853745] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.853865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.853949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.854148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.854233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.854351] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be updated. [ 666.914531] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.914871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.914871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.915636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.915636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.930832] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 in Status: IN_PROGRESS for 2s [ 666.960217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.960454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.960505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.960931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.960931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.980552] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 2s [ 666.983823] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.489978] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.958191] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd94e034-7289-4a18-8431-d4bba42b0823 in Status: SUCCESS [ 667.958621] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd94e034-7289-4a18-8431-d4bba42b0823 deletion is rescheduled due to dependency. [ 667.958841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd94e034-7289-4a18-8431-d4bba42b0823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.994852] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.995060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.995103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.995857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.995857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.995857] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 668.027053] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.027053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.027053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.027053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.027053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.041682] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 668.948126] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 in Status: SUCCESS [ 668.949547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.997858] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 668.998064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.707362] env[65162]: INFO networking_nsxv3.common.synchronization [req-31f34e1f-518b-42c2-8535-d32ec8cf3db3 req-f58ff8a7-a548-4312-a643-504486d092ab tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 669.708996] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 669.709290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.711785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.711785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.711785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.711785] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.711785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.711785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.711785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.712250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.712250] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.051331] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.054021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.054021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.054021] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.215980] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.314919] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.315086] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.315207] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.315556] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.318768] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.318768] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.318768] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.318768] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.318768] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.318768] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.318768] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.318768] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.318768] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.319527] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.319527] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.319527] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.338842] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.339038] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.339155] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.339326] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.339654] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-1007dea6-8861-412b-a235-002d9fc52299 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.339855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.340122] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.340298] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.340432] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1007dea6-8861-412b-a235-002d9fc52299',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.557317] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.557430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.557620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.557955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.558270] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.558502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.558543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.558805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.558953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.559129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.559385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.559552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.559659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.559898] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.560385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.560508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.560575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.560731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.560828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.560943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.561083] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.718239] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.843950] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.844285] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.844414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.844808] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.845033] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.845167] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 1007dea6-8861-412b-a235-002d9fc52299 not found, creating... [ 670.845468] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.845847] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.845847] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.846131] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.846293] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.846602] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.846833] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.846978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.847228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.847468] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.847569] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 1007dea6-8861-412b-a235-002d9fc52299 is going to be created. [ 670.873098] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.873376] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.873536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.873816] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.874217] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.874509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.063796] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24634bde-1ed8-4d4f-9db6-b19816b628d7: rpc.has_security_group_logging(os_id): False [ 671.089065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.089065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.089065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.089472] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.089472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.089472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.089593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.089667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.090363] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.090363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.090363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.090611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.090722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.090834] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 671.165813] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.166053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.166113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.166335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.166487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.181703] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 671.221315] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.221527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.222063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.222063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.222063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.222063] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be updated. [ 671.270699] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.270858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.270930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.271253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.271403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.281585] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 671.632832] env[65162]: INFO networking_nsxv3.common.synchronization [req-31f34e1f-518b-42c2-8535-d32ec8cf3db3 req-f283a098-db7b-4006-9bbe-bfa88e06a284 service nova] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_rules [ 671.634132] env[65162]: INFO networking_nsxv3.common.synchronization [req-31f34e1f-518b-42c2-8535-d32ec8cf3db3 req-f283a098-db7b-4006-9bbe-bfa88e06a284 service nova] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 671.634422] env[65162]: INFO networking_nsxv3.common.synchronization [req-31f34e1f-518b-42c2-8535-d32ec8cf3db3 req-f283a098-db7b-4006-9bbe-bfa88e06a284 service nova] Enqueued Resource ID: 1007dea6-8861-412b-a235-002d9fc52299 with Priority: HIGHEST for action port [ 671.635152] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_rules [ 671.635229] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 671.635399] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1007dea6-8861-412b-a235-002d9fc52299 with Priority: HIGHEST for action port [ 671.635746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.636239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.636239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.636490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.636490] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.637542] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.637712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.638144] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-1007dea6-8861-412b-a235-002d9fc52299 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.638568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.638568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.638704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.638786] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1007dea6-8861-412b-a235-002d9fc52299',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.141891] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.142397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.142397] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1007dea6-8861-412b-a235-002d9fc52299 with status ACTIVE [ 672.142604] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.142691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.142759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.142940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.143077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.143233] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.143458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.143559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.144018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.144018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.144145] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.144246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.144335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.144464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.144531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.144624] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1007dea6-8861-412b-a235-002d9fc52299 is going to be updated. [ 672.173764] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.174244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.174244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.174570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.174721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.174947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1007dea6-8861-412b-a235-002d9fc52299" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.590070] env[65162]: INFO networking_nsxv3.common.synchronization [req-65188c42-ed36-4458-bb15-4c949267eca6 req-e40d985d-f6b4-42b3-8cae-b9e6db2518da tempest-TenantUsagesTestJSON-1896945488 tempest-TenantUsagesTestJSON-1896945488-project-member] Enqueued Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_members [ 672.590915] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0acf84-468d-4a9a-80be-4595d495629a with Priority: HIGHEST for action security_group_members [ 672.591175] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec0acf84-468d-4a9a-80be-4595d495629a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.591419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.591493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.591753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.591963] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.592144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.592144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.592348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.592409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.592493] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec0acf84-468d-4a9a-80be-4595d495629a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.095962] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.096375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.096375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.096547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.096642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.096840] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.096936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.097034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.097171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.097247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.097335] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0acf84-468d-4a9a-80be-4595d495629a is going to be updated. [ 673.128475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.128475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.128475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.128475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.128475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.139575] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0acf84-468d-4a9a-80be-4595d495629a in Status: IN_PROGRESS for 2s [ 673.201366] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 673.202459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.270231] env[65162]: INFO networking_nsxv3.common.synchronization [None req-a30db131-432b-42ff-ae73-8d94042fb9f2 None None] Enqueued Resource ID: 83eac518-d2f4-4ecf-891f-9de5157f6e99 with Priority: HIGHEST for action port [ 673.271243] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83eac518-d2f4-4ecf-891f-9de5157f6e99 with Priority: HIGHEST for action port [ 673.274768] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-83eac518-d2f4-4ecf-891f-9de5157f6e99 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.274768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83eac518-d2f4-4ecf-891f-9de5157f6e99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.274768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83eac518-d2f4-4ecf-891f-9de5157f6e99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.275346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83eac518-d2f4-4ecf-891f-9de5157f6e99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.275346] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83eac518-d2f4-4ecf-891f-9de5157f6e99',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.295138] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 673.295398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.295955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.296357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.296653] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.296868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.296939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.297147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.297237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.297342] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.526443] env[65162]: INFO networking_nsxv3.common.synchronization [req-d5265529-b729-4819-a695-2bc4dd4a8091 req-43be1373-fb0d-46b4-9b59-ad4025091395 tempest-ServerActionsV293TestJSON-1615156236 tempest-ServerActionsV293TestJSON-1615156236-project-member] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_members [ 673.527008] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_members [ 673.527319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.527443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.527515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.527901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.528162] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.528279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.528340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.528509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.528599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.528693] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.779072] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83eac518-d2f4-4ecf-891f-9de5157f6e99 [ 673.781109] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.781412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.781907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.781907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.781907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.782257] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83eac518-d2f4-4ecf-891f-9de5157f6e99 already deleted. [ 673.782634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83eac518-d2f4-4ecf-891f-9de5157f6e99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.801028] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.007256] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.007525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-268" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.007673] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-268" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.008064] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-268" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.010018] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.010018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.010018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.010018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.010018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.010018] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.010018] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.010018] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.010018] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.010018] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.010018] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.010018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.030668] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.032524] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.032765] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.032979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-268" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.033429] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-83301a7f-3c25-4ea5-9bdd-436a54b7de63 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.033620] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.033738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.034065] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.034213] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83301a7f-3c25-4ea5-9bdd-436a54b7de63',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.035482] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.035605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.035674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.035857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.035944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.036151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.036251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.036314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.036465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.036542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.036629] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 already deleted. [ 674.036711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.307741] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.425658] env[65162]: INFO networking_nsxv3.common.synchronization [req-28734f23-f5ee-492e-a4b9-4737ae4a0755 req-4628e985-dfa8-4afe-baaa-23e048224b62 tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 with Priority: HIGHEST for action security_group_rules [ 674.426418] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 with Priority: HIGHEST for action security_group_rules [ 674.426734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f503ecd-9d45-447c-9960-4f81bb4c7903 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.426878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.427055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.427201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.427283] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f503ecd-9d45-447c-9960-4f81bb4c7903',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.538729] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.539644] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.539785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.541044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.541044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.541044] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 83301a7f-3c25-4ea5-9bdd-436a54b7de63 not found, creating... [ 674.541044] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.541044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.541044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.541416] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.541511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.541868] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.542957] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.543237] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.543814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.544630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.544826] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 83301a7f-3c25-4ea5-9bdd-436a54b7de63 is going to be created. [ 674.570070] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.570305] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.570305] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.570785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.570984] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.571306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.809286] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.809554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.809632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.810313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.810313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.810313] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be updated. [ 674.857982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.858294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.858294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.858602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.859846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.870390] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 674.963757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.964036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.964129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.964418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964651] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 already deleted. [ 674.964754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.149965] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec0acf84-468d-4a9a-80be-4595d495629a in Status: SUCCESS [ 675.150280] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec0acf84-468d-4a9a-80be-4595d495629a deletion is rescheduled due to dependency. [ 675.150446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec0acf84-468d-4a9a-80be-4595d495629a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.342065] env[65162]: INFO networking_nsxv3.common.synchronization [req-d5265529-b729-4819-a695-2bc4dd4a8091 req-ca0a79e4-b0ca-4e87-a432-4691ea68a5f9 service nova] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_rules [ 675.342065] env[65162]: INFO networking_nsxv3.common.synchronization [req-d5265529-b729-4819-a695-2bc4dd4a8091 req-ca0a79e4-b0ca-4e87-a432-4691ea68a5f9 service nova] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_members [ 675.342417] env[65162]: INFO networking_nsxv3.common.synchronization [req-d5265529-b729-4819-a695-2bc4dd4a8091 req-ca0a79e4-b0ca-4e87-a432-4691ea68a5f9 service nova] Enqueued Resource ID: 83301a7f-3c25-4ea5-9bdd-436a54b7de63 with Priority: HIGHEST for action port [ 675.344178] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_rules [ 675.344178] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_members [ 675.344178] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83301a7f-3c25-4ea5-9bdd-436a54b7de63 with Priority: HIGHEST for action port [ 675.344883] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.344883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.344883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.345168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.345277] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.347768] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.347917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.348311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.348311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.348436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.348436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.348566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.348712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.348805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.348902] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.350398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-83301a7f-3c25-4ea5-9bdd-436a54b7de63 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.350398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.350398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.350398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.350398] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83301a7f-3c25-4ea5-9bdd-436a54b7de63',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.359175] env[65162]: INFO networking_nsxv3.common.synchronization [None req-89549ee8-390b-4f23-b967-c1bfff3aa194 None None] Enqueued Resource ID: 7bb8b6a0-8c38-4933-ad3f-8458d074f534 with Priority: HIGHEST for action port [ 675.359767] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb8b6a0-8c38-4933-ad3f-8458d074f534 with Priority: HIGHEST for action port [ 675.360183] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bb8b6a0-8c38-4933-ad3f-8458d074f534 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.360389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bb8b6a0-8c38-4933-ad3f-8458d074f534" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.360527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bb8b6a0-8c38-4933-ad3f-8458d074f534" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.360854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bb8b6a0-8c38-4933-ad3f-8458d074f534" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.360976] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bb8b6a0-8c38-4933-ad3f-8458d074f534',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.848369] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.848369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.851691] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.854566] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83301a7f-3c25-4ea5-9bdd-436a54b7de63 with status ACTIVE [ 675.855160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.855309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.855425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.855670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.855670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.855963] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.856097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.856163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.856438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.856629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.856904] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.857174] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.857278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.857485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.857611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.857731] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83301a7f-3c25-4ea5-9bdd-436a54b7de63 is going to be updated. [ 675.866217] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bb8b6a0-8c38-4933-ad3f-8458d074f534 [ 675.866502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.866671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.866765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.867859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.867859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.867859] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bb8b6a0-8c38-4933-ad3f-8458d074f534 already deleted. [ 675.867859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bb8b6a0-8c38-4933-ad3f-8458d074f534" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.878892] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.879083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.879145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.879342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.879481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.879646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83301a7f-3c25-4ea5-9bdd-436a54b7de63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.360197] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.380163] env[65162]: INFO networking_nsxv3.common.synchronization [None req-dcd7b47b-21aa-44a1-b850-f6d1a9fbd5b6 None None] Enqueued Resource ID: 493e20a4-36dc-43d7-98fc-8e47015de978 with Priority: HIGHEST for action port [ 676.380656] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493e20a4-36dc-43d7-98fc-8e47015de978 with Priority: HIGHEST for action port [ 676.380979] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-493e20a4-36dc-43d7-98fc-8e47015de978 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.381519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-493e20a4-36dc-43d7-98fc-8e47015de978" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.381634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-493e20a4-36dc-43d7-98fc-8e47015de978" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.382145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-493e20a4-36dc-43d7-98fc-8e47015de978" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.382145] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493e20a4-36dc-43d7-98fc-8e47015de978',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.864292] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.864500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.864568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.864789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.864918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.864987] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 is going to be created. [ 676.881038] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 676.881249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.881297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.882181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.882181] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.882357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.882435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.882635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.882711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.882805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.882903] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.884099] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 493e20a4-36dc-43d7-98fc-8e47015de978 [ 676.884272] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.884382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.884445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.884789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.884887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.885012] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:493e20a4-36dc-43d7-98fc-8e47015de978 already deleted. [ 676.885102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-493e20a4-36dc-43d7-98fc-8e47015de978" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.892842] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.892999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.893060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.893255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.893466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.905844] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 in Status: UNINITIALIZED for 2s [ 677.388564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.388903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.388903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.389083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.389252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.389354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.389436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.389595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.389703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.389794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.389939] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.390046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.390102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.390245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.390389] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.390483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.390542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.390680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.390755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.390838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.390935] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.798042] env[65162]: INFO networking_nsxv3.common.synchronization [req-8eb3de94-6cd8-4093-9200-3d599a638e70 req-f20dbce7-08a6-4dfd-88c2-aec108e20962 tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 with Priority: HIGHEST for action security_group_rules [ 677.798042] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 with Priority: HIGHEST for action security_group_rules [ 677.798042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f503ecd-9d45-447c-9960-4f81bb4c7903 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.798042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.798042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.798042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.798042] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f503ecd-9d45-447c-9960-4f81bb4c7903',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.895268] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2880f64-bee4-45fb-88ef-a60ad0c676d2: rpc.has_security_group_logging(os_id): False [ 677.914978] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.915161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.915220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.919077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.919077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.919077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.919077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.920250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.920250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.920250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.920250] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be updated. [ 677.991713] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.991979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.992071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.992367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.992566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.012093] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 678.325802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.325945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.326026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.326248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.326345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.326429] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 already deleted. [ 678.326510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.490688] env[65162]: INFO networking_nsxv3.common.synchronization [None req-214d6358-e174-4e8f-9d45-c2236c470b30 tempest-ServersTestBootFromVolume-331407756 tempest-ServersTestBootFromVolume-331407756-project-member] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_rules [ 678.490975] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_rules [ 678.491395] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.491537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.491629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.491960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.492117] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.642199] env[65162]: INFO networking_nsxv3.common.synchronization [None req-6681f02a-4118-464f-bb69-013dd751bc16 tempest-ServersTestBootFromVolume-331407756 tempest-ServersTestBootFromVolume-331407756-project-member] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_rules [ 678.642199] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_rules [ 678.642199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.642199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.919763] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 in Status: SUCCESS [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.923019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.923019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.923019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.015260] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.015484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.015484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.015646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.016023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.017132] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 already deleted. [ 679.017132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.017132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.017132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.017132] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.427943] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.539437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.539746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.539746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.539864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.539954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.540070] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 already deleted. [ 679.540156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.583926] env[65162]: INFO networking_nsxv3.common.synchronization [None req-1e37555d-299a-44f6-8c2d-869bef76f17f None None] Enqueued Resource ID: 208bdc7d-0c7d-4d33-8832-29e5772254c8 with Priority: HIGHEST for action port [ 679.585709] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 208bdc7d-0c7d-4d33-8832-29e5772254c8 with Priority: HIGHEST for action port [ 679.585709] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-208bdc7d-0c7d-4d33-8832-29e5772254c8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.586150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-208bdc7d-0c7d-4d33-8832-29e5772254c8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.586150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-208bdc7d-0c7d-4d33-8832-29e5772254c8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.586769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-208bdc7d-0c7d-4d33-8832-29e5772254c8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.586769] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208bdc7d-0c7d-4d33-8832-29e5772254c8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.636276] env[65162]: INFO networking_nsxv3.common.synchronization [req-88571362-7464-4b01-a593-25ca15ba2ada req-8e11a186-2208-41c5-9bfe-8a9aabdedc2c tempest-ServerDiagnosticsNegativeTest-284501361 tempest-ServerDiagnosticsNegativeTest-284501361-project-member] Enqueued Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_members [ 679.637691] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_members [ 679.637691] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.637978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.637978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.638252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.638748] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.638838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.638967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.639212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.639304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.639420] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.931978] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4237fa3-bfbf-4636-ac25-550350b0ee05: rpc.has_security_group_logging(os_id): False [ 679.956023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.956023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.956023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.956023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.956023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.956374] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.956374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.956374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.958653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.958653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.958653] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 is going to be created. [ 680.030262] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.030526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.030526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.030809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.031016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.035288] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 680.035288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.042937] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 in Status: IN_PROGRESS for 2s [ 680.088378] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 208bdc7d-0c7d-4d33-8832-29e5772254c8 [ 680.089441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.089441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.089707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.089954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.090134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.090304] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:208bdc7d-0c7d-4d33-8832-29e5772254c8 already deleted. [ 680.090464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-208bdc7d-0c7d-4d33-8832-29e5772254c8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.145435] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.145435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.145716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.146593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.146593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.146593] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.146593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.146593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.146900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.147028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.147139] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc14b794-c440-4406-844c-ac39d23312a4 already deleted. [ 680.147815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.420336] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.420336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.420336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.420336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.420336] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.420336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.420336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.420336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.421090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.421522] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.421928] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.422727] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.424027] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.424027] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.424027] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.424027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.447027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.447251] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.447419] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.447632] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.448037] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.448297] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.448386] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.448757] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.448911] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77cdd335-bd85-46de-8de8-7a00c1d2bd3c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.951942] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.952361] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.952361] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.952477] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.952592] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.952745] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 77cdd335-bd85-46de-8de8-7a00c1d2bd3c not found, creating... [ 680.953123] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.953224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.953344] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.953608] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.953788] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.954068] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.954234] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.954345] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.954613] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.954815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.954955] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 77cdd335-bd85-46de-8de8-7a00c1d2bd3c is going to be created. [ 680.998549] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.998549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.998549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.998549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.998549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.998549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.727309] env[65162]: INFO networking_nsxv3.common.synchronization [req-88571362-7464-4b01-a593-25ca15ba2ada req-c4d3e712-1ae8-4073-ae9e-ea767826ecd0 service nova] Enqueued Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_rules [ 681.727309] env[65162]: INFO networking_nsxv3.common.synchronization [req-88571362-7464-4b01-a593-25ca15ba2ada req-c4d3e712-1ae8-4073-ae9e-ea767826ecd0 service nova] Enqueued Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_members [ 681.727309] env[65162]: INFO networking_nsxv3.common.synchronization [req-88571362-7464-4b01-a593-25ca15ba2ada req-c4d3e712-1ae8-4073-ae9e-ea767826ecd0 service nova] Enqueued Resource ID: 77cdd335-bd85-46de-8de8-7a00c1d2bd3c with Priority: HIGHEST for action port [ 681.728461] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_rules [ 681.728461] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_members [ 681.728461] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77cdd335-bd85-46de-8de8-7a00c1d2bd3c with Priority: HIGHEST for action port [ 681.729481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.729481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.729481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.729481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.729481] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.730255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.733238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.733330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.733614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.733845] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.733949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.733949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.734193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.734259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.734342] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.735405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.735567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.735567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.735756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.735829] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77cdd335-bd85-46de-8de8-7a00c1d2bd3c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.057740] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 in Status: SUCCESS [ 682.057740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.237698] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.241275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.241275] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.241275] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77cdd335-bd85-46de-8de8-7a00c1d2bd3c with status ACTIVE [ 682.241275] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.241275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.241275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.241275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.241275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.242867] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.243198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.245688] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.245688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.245688] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77cdd335-bd85-46de-8de8-7a00c1d2bd3c is going to be updated. [ 682.274580] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.274580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.274580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.274580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.274580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.274580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77cdd335-bd85-46de-8de8-7a00c1d2bd3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.598323] env[65162]: INFO networking_nsxv3.common.synchronization [None req-e7c1b71a-b113-4366-b54a-b09d16c1ca99 None None] Enqueued Resource ID: 5f95b92e-06fb-457a-8221-cae88e314c56 with Priority: HIGHEST for action port [ 682.598984] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f95b92e-06fb-457a-8221-cae88e314c56 with Priority: HIGHEST for action port [ 682.600487] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f95b92e-06fb-457a-8221-cae88e314c56 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.600632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f95b92e-06fb-457a-8221-cae88e314c56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.600715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f95b92e-06fb-457a-8221-cae88e314c56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.601034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f95b92e-06fb-457a-8221-cae88e314c56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.601402] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f95b92e-06fb-457a-8221-cae88e314c56',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.750429] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.107238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f95b92e-06fb-457a-8221-cae88e314c56 [ 683.107238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.107238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.107238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.107238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.107238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.107238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f95b92e-06fb-457a-8221-cae88e314c56 already deleted. [ 683.107238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f95b92e-06fb-457a-8221-cae88e314c56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.254940] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.256036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.256036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.256036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.256036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.256283] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc14b794-c440-4406-844c-ac39d23312a4 is going to be created. [ 683.303328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.303328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.303328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.303695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.303964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.319309] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc14b794-c440-4406-844c-ac39d23312a4 in Status: UNINITIALIZED for 2s [ 684.095605] env[65162]: INFO networking_nsxv3.common.synchronization [req-c9e89fce-49c2-4855-b0f1-38d8dcbb42ef req-3f9c3221-a0cb-401d-b799-d86f9ea9d6fa tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 684.095992] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 684.096743] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.096743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.096910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.097113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.097277] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.097770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.097770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.097770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.097770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.097770] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.599362] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.599362] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.599362] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.603219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.603219] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.603219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.603219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.603219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.603219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.603219] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.603219] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.603219] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.603806] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.603806] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.603806] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.603806] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.605635] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.605949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.606085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.606235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.606329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.606512] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.606611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.606723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.607043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.607129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.607210] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb already deleted. [ 684.607287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.639523] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.639726] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.639867] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.640058] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.640381] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-6151f166-ceb6-4d79-b629-579b6145ad76 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.640549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.640681] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.640995] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.641144] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6151f166-ceb6-4d79-b629-579b6145ad76',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.844174] env[65162]: INFO networking_nsxv3.common.synchronization [None req-323ffc2f-8c25-464a-b5d1-c9a6bc480f6f None None] Enqueued Resource ID: 79a05b70-cc72-4c22-bcf7-28d49fcd7f41 with Priority: HIGHEST for action port [ 684.846218] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79a05b70-cc72-4c22-bcf7-28d49fcd7f41 with Priority: HIGHEST for action port [ 684.846344] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-79a05b70-cc72-4c22-bcf7-28d49fcd7f41 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.846538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79a05b70-cc72-4c22-bcf7-28d49fcd7f41" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.846676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79a05b70-cc72-4c22-bcf7-28d49fcd7f41" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.847241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79a05b70-cc72-4c22-bcf7-28d49fcd7f41" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.847500] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79a05b70-cc72-4c22-bcf7-28d49fcd7f41',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.143411] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.143713] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.144032] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.144342] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.144538] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.144695] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 6151f166-ceb6-4d79-b629-579b6145ad76 not found, creating... [ 685.144981] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.145206] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.147325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.147855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.147855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.148164] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.148458] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.148458] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.148627] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.148887] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.150362] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 6151f166-ceb6-4d79-b629-579b6145ad76 is going to be created. [ 685.173961] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.174198] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.174294] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.174740] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.174978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.175222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.332226] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc14b794-c440-4406-844c-ac39d23312a4 in Status: SUCCESS [ 685.332721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.332721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.332925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.333096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.333239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.333381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.333558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.333643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.333734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.333823] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.350381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79a05b70-cc72-4c22-bcf7-28d49fcd7f41 [ 685.350654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.350774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.350774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.351807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.351930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.352053] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79a05b70-cc72-4c22-bcf7-28d49fcd7f41 already deleted. [ 685.352138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79a05b70-cc72-4c22-bcf7-28d49fcd7f41" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.752066] env[65162]: INFO networking_nsxv3.common.synchronization [req-e2284912-fd97-494b-b653-1a22854389b5 req-2999b956-24de-41d4-ac1b-50fa3e1a49a6 tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 685.755108] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 685.755632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.755876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.756031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.756448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.756695] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.756866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.756978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.757269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.757417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.757583] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.952327] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.952468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.952532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.952820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.952985] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.953106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.953158] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.953304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.953389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.953495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.953645] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.953735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.953815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.954045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.954185] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.954277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.954408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.954471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.954567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.954665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.954751] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.957319] env[65162]: INFO networking_nsxv3.common.synchronization [req-c9e89fce-49c2-4855-b0f1-38d8dcbb42ef req-fdd56c99-94a2-411c-803b-c77082499565 service nova] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 685.957472] env[65162]: INFO networking_nsxv3.common.synchronization [req-c9e89fce-49c2-4855-b0f1-38d8dcbb42ef req-fdd56c99-94a2-411c-803b-c77082499565 service nova] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 685.957599] env[65162]: INFO networking_nsxv3.common.synchronization [req-c9e89fce-49c2-4855-b0f1-38d8dcbb42ef req-fdd56c99-94a2-411c-803b-c77082499565 service nova] Enqueued Resource ID: 6151f166-ceb6-4d79-b629-579b6145ad76 with Priority: HIGHEST for action port [ 685.959548] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 685.959548] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 685.959548] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6151f166-ceb6-4d79-b629-579b6145ad76 with Priority: HIGHEST for action port [ 685.959548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.959919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.959919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.960107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.960328] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.961637] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.961739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.961938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962203] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.962299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.962362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.962684] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.963495] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6151f166-ceb6-4d79-b629-579b6145ad76 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.963605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.964335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.964335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.964335] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6151f166-ceb6-4d79-b629-579b6145ad76',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.261846] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.262131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.262131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.262339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.262397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.262583] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.262677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.262750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.262899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.262966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.263056] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be updated. [ 686.297873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.298072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.298127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.301226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.301226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.310063] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 686.311697] env[65162]: INFO networking_nsxv3.common.synchronization [None req-cfb04cbd-f64b-4c41-8dc5-b6ffd4ec3640 None None] Enqueued Resource ID: 3f623a9a-5b10-432b-98df-56ddf1efa759 with Priority: HIGHEST for action port [ 686.313338] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f623a9a-5b10-432b-98df-56ddf1efa759 with Priority: HIGHEST for action port [ 686.313338] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f623a9a-5b10-432b-98df-56ddf1efa759 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.313338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f623a9a-5b10-432b-98df-56ddf1efa759" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.313338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f623a9a-5b10-432b-98df-56ddf1efa759" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.313338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f623a9a-5b10-432b-98df-56ddf1efa759" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.313338] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f623a9a-5b10-432b-98df-56ddf1efa759',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.459810] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc14b794-c440-4406-844c-ac39d23312a4: rpc.has_security_group_logging(os_id): False [ 686.467710] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.467941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.468075] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.468974] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6151f166-ceb6-4d79-b629-579b6145ad76 with status ACTIVE [ 686.469253] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.469430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.469430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.469546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.469627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.469789] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.469884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.469940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.470107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.470176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.470351] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.470432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.470595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.471342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.471418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.471499] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6151f166-ceb6-4d79-b629-579b6145ad76 is going to be updated. [ 686.480587] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.480764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.481041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.481376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.481533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.481735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.481848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.481921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.482076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.482157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.482338] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.482429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.482491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.482749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.482749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.483038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.483038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.483136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.483312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.483381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.483455] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc14b794-c440-4406-844c-ac39d23312a4 is going to be created. [ 686.497793] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.497951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.498036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.498334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.498409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.498577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6151f166-ceb6-4d79-b629-579b6145ad76" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.549989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.550203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.550255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.550742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.550958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.565639] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc14b794-c440-4406-844c-ac39d23312a4 in Status: IN_PROGRESS for 2s [ 686.815617] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f623a9a-5b10-432b-98df-56ddf1efa759 [ 686.817605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.817605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.817605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.817925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.817925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.817925] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f623a9a-5b10-432b-98df-56ddf1efa759 already deleted. [ 686.817925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f623a9a-5b10-432b-98df-56ddf1efa759" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.975425] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.482564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.482742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.482797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.483039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.483150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.483253] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be created. [ 687.517115] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.517296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.517367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.517585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.518595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.528066] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: UNINITIALIZED for 2s [ 687.740864] env[65162]: INFO networking_nsxv3.common.synchronization [req-52cd19ab-b23d-4580-b27c-1f0fa1a9bc23 req-30cf4577-27cb-4a44-a6e7-5e70e2a1fed4 tempest-SecurityGroupRulesTestJSON-2114706539 tempest-SecurityGroupRulesTestJSON-2114706539-project-member] Enqueued Resource ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 with Priority: HIGHEST for action security_group_rules [ 687.741437] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 with Priority: HIGHEST for action security_group_rules [ 687.741742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f503ecd-9d45-447c-9960-4f81bb4c7903 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.741869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.741943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.742476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.742565] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f503ecd-9d45-447c-9960-4f81bb4c7903',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.269734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.270239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.270239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.270239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.270239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.271193] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f503ecd-9d45-447c-9960-4f81bb4c7903 already deleted. [ 688.271193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f503ecd-9d45-447c-9960-4f81bb4c7903" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.326527] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 688.326718] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 deletion is rescheduled due to dependency. [ 688.326826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.566798] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c012eb29-85fc-44c0-be3b-3751f8426b51 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_rules [ 688.568550] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_rules [ 688.568818] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.568934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.568992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.569261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.569336] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.584125] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc14b794-c440-4406-844c-ac39d23312a4 in Status: SUCCESS [ 688.584348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.701752] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b106a5a6-68fd-4307-ae71-fa4abd34858d tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_rules [ 688.702329] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_rules [ 688.702627] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.702724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.841413] env[65162]: INFO networking_nsxv3.common.synchronization [None req-eb1bbcd9-9d55-40a5-a2d1-22bc8486b55d None None] Enqueued Resource ID: 83df1bf9-c1fa-4a1e-9b93-2c0daf656c34 with Priority: HIGHEST for action port [ 688.841413] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83df1bf9-c1fa-4a1e-9b93-2c0daf656c34 with Priority: HIGHEST for action port [ 688.841413] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-83df1bf9-c1fa-4a1e-9b93-2c0daf656c34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.841413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83df1bf9-c1fa-4a1e-9b93-2c0daf656c34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.841413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83df1bf9-c1fa-4a1e-9b93-2c0daf656c34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.842342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83df1bf9-c1fa-4a1e-9b93-2c0daf656c34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.842541] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83df1bf9-c1fa-4a1e-9b93-2c0daf656c34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.096962] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.097485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.097589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.097759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.098148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.098256] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 already deleted. [ 689.098352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.098523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.098890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.099014] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.346235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83df1bf9-c1fa-4a1e-9b93-2c0daf656c34 [ 689.346539] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.346539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.346539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.346713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.346807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.346887] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83df1bf9-c1fa-4a1e-9b93-2c0daf656c34 already deleted. [ 689.346984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83df1bf9-c1fa-4a1e-9b93-2c0daf656c34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.541728] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 689.541728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.541728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.541728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542216] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.542216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.542216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.542353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.542419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.542527] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.629288] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.629288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.629288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.629288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.629288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.629288] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 already deleted. [ 689.629288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.045224] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.550824] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a02c478-9c75-420c-a387-bc52bfa702cb: rpc.has_security_group_logging(os_id): False [ 690.575961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.576367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.576367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.576525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.577444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.577444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.577444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.577444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.577444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.577444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.577444] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be created. [ 690.666903] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.668764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.668764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.668764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.668764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.682014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 691.375761] env[65162]: INFO networking_nsxv3.common.synchronization [req-28d0ee20-7de2-45a7-b703-cc653263d0a3 req-51a88dc3-2f1a-45d4-894e-34b7e1df915a tempest-DeleteServersAdminTestJSON-500387442 tempest-DeleteServersAdminTestJSON-500387442-project-member] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 691.376393] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGHEST for action security_group_members [ 691.376699] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.376852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.379738] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.379738] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.767146] env[65162]: INFO networking_nsxv3.common.synchronization [req-35314aeb-3c3a-4046-bb36-20da8f3c738d req-f1455092-d564-47c3-9c32-93f5c9496d47 tempest-FloatingIPsAssociationTestJSON-1766689371 tempest-FloatingIPsAssociationTestJSON-1766689371-project-member] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 691.767146] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 691.767715] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.767715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.767715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.767853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.768460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.769121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.769121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.769121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.769121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.770124] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.806454] env[65162]: INFO networking_nsxv3.common.synchronization [None req-bb0f8d16-1c83-46b8-a0af-beae172c7988 None None] Enqueued Resource ID: 26365cec-6139-4488-84c2-b63f9ca09a32 with Priority: HIGHEST for action port [ 691.807020] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26365cec-6139-4488-84c2-b63f9ca09a32 with Priority: HIGHEST for action port [ 691.808081] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-26365cec-6139-4488-84c2-b63f9ca09a32 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.808081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26365cec-6139-4488-84c2-b63f9ca09a32" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.808081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26365cec-6139-4488-84c2-b63f9ca09a32" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.808081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26365cec-6139-4488-84c2-b63f9ca09a32" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.808081] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26365cec-6139-4488-84c2-b63f9ca09a32',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.882933] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.883127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.883188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.883374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.883465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.883727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.883868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.883925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.884082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.884154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.884241] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be updated. [ 691.917118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.917287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.917340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.919788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.919788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.927439] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: IN_PROGRESS for 2s [ 692.273014] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.311696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26365cec-6139-4488-84c2-b63f9ca09a32 [ 692.311943] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.312093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.312164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.312390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.312592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.312649] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26365cec-6139-4488-84c2-b63f9ca09a32 already deleted. [ 692.312741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26365cec-6139-4488-84c2-b63f9ca09a32" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.706478] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 692.706478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.776585] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.279716] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.280404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.281217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.281217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.283363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.283363] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be updated. [ 693.316179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.316179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.316179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.316179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.316179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.328695] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: IN_PROGRESS for 2s [ 693.895034] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ffbdd061-dd5c-42ca-9cdf-cc043c2ebf1d None None] Enqueued Resource ID: 6ed60597-8b8a-4c81-92bb-b1b2fff11d70 with Priority: HIGHEST for action port [ 693.896820] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed60597-8b8a-4c81-92bb-b1b2fff11d70 with Priority: HIGHEST for action port [ 693.896977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed60597-8b8a-4c81-92bb-b1b2fff11d70 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.897125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed60597-8b8a-4c81-92bb-b1b2fff11d70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.897318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed60597-8b8a-4c81-92bb-b1b2fff11d70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.897527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed60597-8b8a-4c81-92bb-b1b2fff11d70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.897527] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed60597-8b8a-4c81-92bb-b1b2fff11d70',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.940130] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 in Status: SUCCESS [ 693.940572] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 deletion is rescheduled due to dependency. [ 693.940858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.403271] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ed60597-8b8a-4c81-92bb-b1b2fff11d70 [ 694.403271] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.403271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.403271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.403271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.403271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.403271] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ed60597-8b8a-4c81-92bb-b1b2fff11d70 already deleted. [ 694.403271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed60597-8b8a-4c81-92bb-b1b2fff11d70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.585950] env[65162]: INFO networking_nsxv3.common.synchronization [None req-cb324cc2-03d9-4ecd-8e47-3f62ca25e50a None None] Enqueued Resource ID: e058171a-ada8-4b74-bad9-9a1df03bc27f with Priority: HIGHEST for action port [ 694.586833] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e058171a-ada8-4b74-bad9-9a1df03bc27f with Priority: HIGHEST for action port [ 694.588218] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e058171a-ada8-4b74-bad9-9a1df03bc27f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.588408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e058171a-ada8-4b74-bad9-9a1df03bc27f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.588497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e058171a-ada8-4b74-bad9-9a1df03bc27f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.590028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e058171a-ada8-4b74-bad9-9a1df03bc27f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.590121] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e058171a-ada8-4b74-bad9-9a1df03bc27f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.093318] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e058171a-ada8-4b74-bad9-9a1df03bc27f [ 695.093627] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.093778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.093853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.098022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.098022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.098022] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e058171a-ada8-4b74-bad9-9a1df03bc27f already deleted. [ 695.098022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e058171a-ada8-4b74-bad9-9a1df03bc27f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.340395] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 695.340726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.377639] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4ed41f1-33b6-4dfe-a791-6f50055ab140 req-0408cd20-7f4a-43a7-ba29-3911b7b32b71 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 696.378640] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 696.379480] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.379674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.379857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.380128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.380960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.380960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.380960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.380960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.380960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.381257] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.836332] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.836540] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.836698] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.836991] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.837295] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.837487] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.838174] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.838272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.838452] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.838685] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.838821] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.839320] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.839320] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.839320] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.839320] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.839532] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.858293] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.858460] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 696.858594] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.858771] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.859106] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.859275] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.859385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.860204] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.860204] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('297d8a22-a7dc-4ff3-a439-483e1b4ebf2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.883253] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.069244] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ed54ee43-969f-4a3c-94ab-96690a2f3322 None None] Enqueued Resource ID: b00bd093-a82d-4142-9f4d-8f68b86a00a0 with Priority: HIGHEST for action port [ 697.070100] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00bd093-a82d-4142-9f4d-8f68b86a00a0 with Priority: HIGHEST for action port [ 697.070596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00bd093-a82d-4142-9f4d-8f68b86a00a0 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.070795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00bd093-a82d-4142-9f4d-8f68b86a00a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.070907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00bd093-a82d-4142-9f4d-8f68b86a00a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.071701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00bd093-a82d-4142-9f4d-8f68b86a00a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.071837] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00bd093-a82d-4142-9f4d-8f68b86a00a0',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.324755] env[65162]: INFO networking_nsxv3.common.synchronization [None req-72a7d977-1670-4330-90eb-9e88b09faef0 None None] Enqueued Resource ID: fe7d97fc-5d7f-4fee-a29e-f738c9202225 with Priority: HIGHEST for action port [ 697.325463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7d97fc-5d7f-4fee-a29e-f738c9202225 with Priority: HIGHEST for action port [ 697.325817] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe7d97fc-5d7f-4fee-a29e-f738c9202225 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.326030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe7d97fc-5d7f-4fee-a29e-f738c9202225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.326179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe7d97fc-5d7f-4fee-a29e-f738c9202225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.326538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe7d97fc-5d7f-4fee-a29e-f738c9202225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.326667] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe7d97fc-5d7f-4fee-a29e-f738c9202225',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.362511] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.362832] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.362919] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.363216] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.363369] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.363554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 297d8a22-a7dc-4ff3-a439-483e1b4ebf2f not found, creating... [ 697.363905] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.364079] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.364195] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.364790] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.364790] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.364790] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.365184] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.365184] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.365367] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.365412] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.365538] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 297d8a22-a7dc-4ff3-a439-483e1b4ebf2f is going to be created. [ 697.387310] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.390887] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.392228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.392228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.393398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.396169] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.396169] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.575042] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b00bd093-a82d-4142-9f4d-8f68b86a00a0 [ 697.575042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.575290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.575290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.576086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.576086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.576086] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b00bd093-a82d-4142-9f4d-8f68b86a00a0 already deleted. [ 697.576086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00bd093-a82d-4142-9f4d-8f68b86a00a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.828732] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe7d97fc-5d7f-4fee-a29e-f738c9202225 [ 697.828975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.829210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.829525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.829728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.829853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.829973] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe7d97fc-5d7f-4fee-a29e-f738c9202225 already deleted. [ 697.830116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe7d97fc-5d7f-4fee-a29e-f738c9202225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.896667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.896904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.896971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.897385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.897555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.897730] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 697.938034] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.938213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.938388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.938768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.938768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.951024] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 698.363775] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4ed41f1-33b6-4dfe-a791-6f50055ab140 req-b1a8b2bb-3774-4638-8f67-f210a8c76556 service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 698.363967] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4ed41f1-33b6-4dfe-a791-6f50055ab140 req-b1a8b2bb-3774-4638-8f67-f210a8c76556 service nova] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 698.364577] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4ed41f1-33b6-4dfe-a791-6f50055ab140 req-b1a8b2bb-3774-4638-8f67-f210a8c76556 service nova] Enqueued Resource ID: 297d8a22-a7dc-4ff3-a439-483e1b4ebf2f with Priority: HIGHEST for action port [ 698.364695] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_rules [ 698.364838] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 698.364963] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 297d8a22-a7dc-4ff3-a439-483e1b4ebf2f with Priority: HIGHEST for action port [ 698.365234] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.365391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.365441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.366038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.366038] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.366575] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.366684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.366827] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.366922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.367021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.369136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.369136] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('297d8a22-a7dc-4ff3-a439-483e1b4ebf2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.873238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.873238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 297d8a22-a7dc-4ff3-a439-483e1b4ebf2f with status ACTIVE [ 698.873238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.873238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.873238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.874075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.874075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.874075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.874075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.874075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.874075] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 297d8a22-a7dc-4ff3-a439-483e1b4ebf2f is going to be updated. [ 698.898533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.898702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.898777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.898997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.899155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.899325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-297d8a22-a7dc-4ff3-a439-483e1b4ebf2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.962330] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.963871] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.963871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.963871] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.165915] env[65162]: INFO networking_nsxv3.common.synchronization [None req-8e07c9e4-b473-4ba4-a977-4ef016d5add5 None None] Enqueued Resource ID: 8d0afa25-2c74-4e62-af6b-0bca649c9d97 with Priority: HIGHEST for action port [ 700.166534] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d0afa25-2c74-4e62-af6b-0bca649c9d97 with Priority: HIGHEST for action port [ 700.166876] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d0afa25-2c74-4e62-af6b-0bca649c9d97 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.166996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d0afa25-2c74-4e62-af6b-0bca649c9d97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.168761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d0afa25-2c74-4e62-af6b-0bca649c9d97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.169139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d0afa25-2c74-4e62-af6b-0bca649c9d97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.169237] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0afa25-2c74-4e62-af6b-0bca649c9d97',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.468461] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.673144] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d0afa25-2c74-4e62-af6b-0bca649c9d97 [ 700.673144] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.673144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.673144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.673609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.673609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.673609] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d0afa25-2c74-4e62-af6b-0bca649c9d97 already deleted. [ 700.673609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d0afa25-2c74-4e62-af6b-0bca649c9d97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.978305] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.484159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.484537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.484711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.485587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.488036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.488036] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 701.523271] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.523459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.523500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.524319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.524523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.536231] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 701.612538] env[65162]: INFO networking_nsxv3.common.synchronization [None req-78d227a6-c2ff-487b-b3bc-9d05f20f60ac tempest-MigrationsAdminTest-350875998 tempest-MigrationsAdminTest-350875998-project-member] Enqueued Resource ID: a598916d-ccfd-462d-bb68-9c24aa5e1f75 with Priority: HIGHEST for action security_group_rules [ 701.612538] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a598916d-ccfd-462d-bb68-9c24aa5e1f75 with Priority: HIGHEST for action security_group_rules [ 701.612538] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.612538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.612538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.612538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.612538] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a598916d-ccfd-462d-bb68-9c24aa5e1f75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.994839] env[65162]: INFO networking_nsxv3.common.synchronization [req-a37d976d-6b55-45a6-80d3-59af6661f078 req-18eef99a-3a3f-4ec6-b85d-87b8d64fcc2b tempest-InstanceActionsTestJSON-1626656935 tempest-InstanceActionsTestJSON-1626656935-project-member] Enqueued Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_members [ 701.994839] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_members [ 701.995210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.995295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.995348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.995612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.995765] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.995865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.995925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.996099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.996190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.996284] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.132265] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.132461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.132461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.132688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.132846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.132933] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a598916d-ccfd-462d-bb68-9c24aa5e1f75 already deleted. [ 702.132977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.136814] env[65162]: INFO networking_nsxv3.common.synchronization [None req-16e112b3-294b-4d40-a3df-d03da0a5ea84 tempest-MigrationsAdminTest-350875998 tempest-MigrationsAdminTest-350875998-project-member] Enqueued Resource ID: a598916d-ccfd-462d-bb68-9c24aa5e1f75 with Priority: HIGHEST for action security_group_rules [ 702.137378] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a598916d-ccfd-462d-bb68-9c24aa5e1f75 with Priority: HIGHEST for action security_group_rules [ 702.138975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.139213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.139289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.139495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.139576] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a598916d-ccfd-462d-bb68-9c24aa5e1f75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.499199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.499450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.499450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.500084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.500084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.500650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.500796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.500796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.500917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.501031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.501125] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76494ce4-3ed0-426c-ac36-271f9eef282c already deleted. [ 702.501209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.601532] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.601700] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-167" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.601820] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-167" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.602238] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-167" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.602702] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.602872] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.602986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.603249] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.603391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.603638] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.603737] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.603842] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.603945] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.604068] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.604167] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.604295] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.623666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.624024] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.624024] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.624158] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-167" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.624472] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-6c7646ca-b27c-4e85-9c34-28c44196831e taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.624640] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.624806] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.625158] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.625289] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c7646ca-b27c-4e85-9c34-28c44196831e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.663056] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.663250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.663250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.663495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.663631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.663756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a598916d-ccfd-462d-bb68-9c24aa5e1f75 already deleted. [ 702.663869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a598916d-ccfd-462d-bb68-9c24aa5e1f75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.127683] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.130941] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 6c7646ca-b27c-4e85-9c34-28c44196831e not found, creating... [ 703.130941] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.130941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.131615] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.131615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.131615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.131615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.131615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.131615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 6c7646ca-b27c-4e85-9c34-28c44196831e is going to be created. [ 703.153765] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.153988] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.154281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.154400] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.154652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.154920] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.415110] env[65162]: INFO networking_nsxv3.common.synchronization [req-ed14df62-4090-480f-b877-071a0890bc38 req-eaa17e71-a72d-44dc-8967-c0a29689db70 tempest-ServerDiagnosticsNegativeTest-284501361 tempest-ServerDiagnosticsNegativeTest-284501361-project-member] Enqueued Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_members [ 703.415110] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGHEST for action security_group_members [ 703.416268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.416473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.416563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.416926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.417130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.417130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.417299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.417485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.417627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.417781] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.548669] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 703.549252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.549252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.549485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.549717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.549884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.550061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.550267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.550389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.550520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.550638] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.920677] env[65162]: INFO networking_nsxv3.common.synchronization [req-a37d976d-6b55-45a6-80d3-59af6661f078 req-40cfe4e9-9040-4aa6-a982-8937d1b5ca57 service nova] Enqueued Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_rules [ 703.920677] env[65162]: INFO networking_nsxv3.common.synchronization [req-a37d976d-6b55-45a6-80d3-59af6661f078 req-40cfe4e9-9040-4aa6-a982-8937d1b5ca57 service nova] Enqueued Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_members [ 703.920677] env[65162]: INFO networking_nsxv3.common.synchronization [req-a37d976d-6b55-45a6-80d3-59af6661f078 req-40cfe4e9-9040-4aa6-a982-8937d1b5ca57 service nova] Enqueued Resource ID: 6c7646ca-b27c-4e85-9c34-28c44196831e with Priority: HIGHEST for action port [ 703.920677] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_rules [ 703.921159] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_members [ 703.921454] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c7646ca-b27c-4e85-9c34-28c44196831e with Priority: HIGHEST for action port [ 703.921910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.922229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.922377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.922667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.922882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.923192] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.923440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.923623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.924057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.924262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.924456] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc14b794-c440-4406-844c-ac39d23312a4 is going to be updated. [ 703.925794] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.926085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.926233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.929021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.929021] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.929021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.929021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.929021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.929021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.929021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.929021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.929021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.929601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.929785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.929976] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.931022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c7646ca-b27c-4e85-9c34-28c44196831e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.931354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.931660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.931964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.932143] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c7646ca-b27c-4e85-9c34-28c44196831e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.966022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.966022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.966022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.966022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.966022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.977828] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc14b794-c440-4406-844c-ac39d23312a4 in Status: IN_PROGRESS for 2s [ 704.056035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.056035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.056035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.056035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.056035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.056697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.056697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.056697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.056697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.056697] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.435466] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.435466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.436121] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.436727] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c7646ca-b27c-4e85-9c34-28c44196831e with status ACTIVE [ 704.436991] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.437143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.437199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.437808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.439566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.439816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.439960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.440058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.440245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.440336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.440561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.440633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.440864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.440864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.441022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.441022] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c7646ca-b27c-4e85-9c34-28c44196831e is going to be updated. [ 704.468625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.468753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.468827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.469051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.469204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.469752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c7646ca-b27c-4e85-9c34-28c44196831e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.558871] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24634bde-1ed8-4d4f-9db6-b19816b628d7: rpc.has_security_group_logging(os_id): False [ 704.578067] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.578067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.578067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.578067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.578067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.578067] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.578067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.578067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.578502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.578502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.578502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.578595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.578595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.578729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.578798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.579164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.579303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.579335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.579478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.579555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.579640] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 704.690790] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.690958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.691052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.691349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.691533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.714175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 704.944057] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.446895] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.447256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.447256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.447364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.448910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.448910] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76494ce4-3ed0-426c-ac36-271f9eef282c is going to be created. [ 705.473504] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.473504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.473504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.473504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.473504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.485406] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76494ce4-3ed0-426c-ac36-271f9eef282c in Status: UNINITIALIZED for 2s [ 705.990663] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc14b794-c440-4406-844c-ac39d23312a4 in Status: SUCCESS [ 705.990864] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc14b794-c440-4406-844c-ac39d23312a4 deletion is rescheduled due to dependency. [ 705.990981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.734729] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 706.736026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.496085] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76494ce4-3ed0-426c-ac36-271f9eef282c in Status: SUCCESS [ 707.496189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.496356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.496578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.496816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.496947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.497028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.497239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.497365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.497482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.497601] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.003022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.003022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.003022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.003022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.003022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.004149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.004149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.004149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.004149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.004149] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.506275] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76494ce4-3ed0-426c-ac36-271f9eef282c: rpc.has_security_group_logging(os_id): False [ 708.527839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.528020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.528094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.528306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.528412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.528644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.528743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.528871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.528986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.529077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.529268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.529355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.529415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.529551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.529621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.529801] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.529888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.529945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.532030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.532030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.532030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76494ce4-3ed0-426c-ac36-271f9eef282c is going to be created. [ 708.602558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.605022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.605022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.605022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.605022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.619109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76494ce4-3ed0-426c-ac36-271f9eef282c in Status: IN_PROGRESS for 2s [ 708.922302] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 708.922496] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 709.599775] env[65162]: INFO networking_nsxv3.common.synchronization [None req-16f150f1-e422-4456-b484-fd12aa4071d0 tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: fce55f3b-72a8-40b4-af62-1d758273273b with Priority: HIGHEST for action security_group_rules [ 709.600816] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fce55f3b-72a8-40b4-af62-1d758273273b with Priority: HIGHEST for action security_group_rules [ 709.601508] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fce55f3b-72a8-40b4-af62-1d758273273b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.603600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.603600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.603600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.603600] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fce55f3b-72a8-40b4-af62-1d758273273b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.954216] env[65162]: INFO networking_nsxv3.common.synchronization [None req-1e46b992-1230-46b6-b54e-679063de1ec4 tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: fce55f3b-72a8-40b4-af62-1d758273273b with Priority: HIGHEST for action security_group_rules [ 709.955313] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fce55f3b-72a8-40b4-af62-1d758273273b with Priority: HIGHEST for action security_group_rules [ 709.955935] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fce55f3b-72a8-40b4-af62-1d758273273b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.956207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.130038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.130038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.130038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.130038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.130038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.130038] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fce55f3b-72a8-40b4-af62-1d758273273b already deleted. [ 710.130038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.131903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.132255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.132255] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fce55f3b-72a8-40b4-af62-1d758273273b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.637083] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76494ce4-3ed0-426c-ac36-271f9eef282c in Status: SUCCESS [ 710.637083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.656683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.657827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.657827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.657827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.657827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.657827] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fce55f3b-72a8-40b4-af62-1d758273273b already deleted. [ 710.657827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fce55f3b-72a8-40b4-af62-1d758273273b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.939068] env[65162]: INFO networking_nsxv3.common.synchronization [None req-167766b8-1eb8-45be-b7ce-4f791030fd17 None None] Enqueued Resource ID: e1b147af-7dd8-4533-be83-59c8505b44a0 with Priority: HIGHEST for action port [ 710.939615] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1b147af-7dd8-4533-be83-59c8505b44a0 with Priority: HIGHEST for action port [ 710.939918] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1b147af-7dd8-4533-be83-59c8505b44a0 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.940043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1b147af-7dd8-4533-be83-59c8505b44a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.940115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1b147af-7dd8-4533-be83-59c8505b44a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.941038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1b147af-7dd8-4533-be83-59c8505b44a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.941127] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1b147af-7dd8-4533-be83-59c8505b44a0',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.444734] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1b147af-7dd8-4533-be83-59c8505b44a0 [ 711.444734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.444734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.444734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.444958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.444958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.445028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1b147af-7dd8-4533-be83-59c8505b44a0 already deleted. [ 711.445115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1b147af-7dd8-4533-be83-59c8505b44a0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.228240] env[65162]: INFO networking_nsxv3.common.synchronization [None req-19b78d1a-3061-4f81-a1a4-4254a307d065 tempest-ServersTestFqdnHostnames-248459309 tempest-ServersTestFqdnHostnames-248459309-project-member] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_rules [ 713.228240] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_rules [ 713.228240] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.228240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.228240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.228240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.229144] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.397909] env[65162]: INFO networking_nsxv3.common.synchronization [None req-4e7098fc-c2ed-48dd-a93d-099f55c9a5b3 tempest-ServersTestFqdnHostnames-248459309 tempest-ServersTestFqdnHostnames-248459309-project-member] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_rules [ 713.398921] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_rules [ 713.399344] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.399618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.754545] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.754656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.754726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.754946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.755047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.755140] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d8d01f-0537-475c-a915-12d156922e75 already deleted. [ 713.755222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.755380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.755530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.755612] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.282433] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.282828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.282828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.283060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.283060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.283060] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d8d01f-0537-475c-a915-12d156922e75 already deleted. [ 714.283191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.298539] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ca08b4bb-3215-4865-89b0-1f283077dc09 None None] Enqueued Resource ID: c381622c-a7d1-4f92-b9db-63e89c8e4a23 with Priority: HIGHEST for action port [ 714.299189] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c381622c-a7d1-4f92-b9db-63e89c8e4a23 with Priority: HIGHEST for action port [ 714.299533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c381622c-a7d1-4f92-b9db-63e89c8e4a23 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.300082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c381622c-a7d1-4f92-b9db-63e89c8e4a23" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.300164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c381622c-a7d1-4f92-b9db-63e89c8e4a23" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.300528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c381622c-a7d1-4f92-b9db-63e89c8e4a23" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.300528] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c381622c-a7d1-4f92-b9db-63e89c8e4a23',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.805441] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c381622c-a7d1-4f92-b9db-63e89c8e4a23 [ 714.805441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.805441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.805441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.805441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.805441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.805441] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c381622c-a7d1-4f92-b9db-63e89c8e4a23 already deleted. [ 714.805441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c381622c-a7d1-4f92-b9db-63e89c8e4a23" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.705496] env[65162]: INFO networking_nsxv3.common.synchronization [None req-62b469cb-1aaf-47e9-a4c7-975e4d7c5ac1 None None] Enqueued Resource ID: 1c66c08a-1031-4016-89f7-e798f9a44dfc with Priority: HIGHEST for action port [ 715.705496] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c66c08a-1031-4016-89f7-e798f9a44dfc with Priority: HIGHEST for action port [ 715.705948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c66c08a-1031-4016-89f7-e798f9a44dfc taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.706123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c66c08a-1031-4016-89f7-e798f9a44dfc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.706445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c66c08a-1031-4016-89f7-e798f9a44dfc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.706739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c66c08a-1031-4016-89f7-e798f9a44dfc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.706830] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c66c08a-1031-4016-89f7-e798f9a44dfc',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.209432] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c66c08a-1031-4016-89f7-e798f9a44dfc [ 716.209686] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.209820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.211223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.211516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.213042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.213042] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c66c08a-1031-4016-89f7-e798f9a44dfc already deleted. [ 716.213042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c66c08a-1031-4016-89f7-e798f9a44dfc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.282073] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddca1a7a-8b2a-45ad-be87-40bff37f6582 req-5735717f-28da-4620-9f8d-b2f1c12acc09 tempest-ListImageFiltersTestJSON-70258688 tempest-ListImageFiltersTestJSON-70258688-project-member] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 716.285053] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 716.285053] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.285272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.285272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.286124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.286124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.286124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.286124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.286124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.286124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.286329] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.789543] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.790225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.790225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.790950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.790950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.792080] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.792080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.792080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.792080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.792080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.792080] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f already deleted. [ 716.792080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.799164] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.799164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.799164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.799164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.799164] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.799164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.799164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.799586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.799828] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.800147] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.800337] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.800522] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.800702] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.800890] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.801075] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.801376] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.826797] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.826963] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.827104] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.827393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.828034] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.828034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.828213] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.828455] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.828585] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2da6c8b5-5dbe-4e15-8fa2-06bb6d849064',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.331281] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.331488] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.331622] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.331947] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.332112] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.332369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 not found, creating... [ 717.332513] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.332669] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.332775] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.332994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.333136] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.333404] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.333550] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.333667] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.333970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.334382] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.334638] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 is going to be created. [ 717.361943] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.362382] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.362461] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.362742] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.364181] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.364335] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.404576] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ba6e1245-d449-47a1-adc2-d867685f56ec None None] Enqueued Resource ID: 17977c57-821a-4911-a482-c647fb3f67ce with Priority: HIGHEST for action port [ 717.405282] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17977c57-821a-4911-a482-c647fb3f67ce with Priority: HIGHEST for action port [ 717.405685] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-17977c57-821a-4911-a482-c647fb3f67ce taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.405842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17977c57-821a-4911-a482-c647fb3f67ce" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.405951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17977c57-821a-4911-a482-c647fb3f67ce" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.406516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17977c57-821a-4911-a482-c647fb3f67ce" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.406634] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17977c57-821a-4911-a482-c647fb3f67ce',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.647577] env[65162]: INFO networking_nsxv3.common.synchronization [None req-d1b82f3f-1c1b-4fa6-906a-7e383e2cb9b9 None None] Enqueued Resource ID: cca985d3-50ed-4d4a-9108-1b1fcfface62 with Priority: HIGHEST for action port [ 717.647949] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca985d3-50ed-4d4a-9108-1b1fcfface62 with Priority: HIGHEST for action port [ 717.648428] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-cca985d3-50ed-4d4a-9108-1b1fcfface62 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.648548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cca985d3-50ed-4d4a-9108-1b1fcfface62" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.648616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cca985d3-50ed-4d4a-9108-1b1fcfface62" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.648900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cca985d3-50ed-4d4a-9108-1b1fcfface62" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.648984] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca985d3-50ed-4d4a-9108-1b1fcfface62',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.877947] env[65162]: INFO networking_nsxv3.common.synchronization [req-9075ee6b-4161-4db2-b9ff-15d20a56647e req-8dc425f5-7717-439d-94bd-6afa76544736 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_members [ 717.878862] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_members [ 717.880204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.880351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.880351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.881317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.882022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.882022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.882022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.882022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.882253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.882330] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.908287] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17977c57-821a-4911-a482-c647fb3f67ce [ 717.909310] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.909310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.909310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.909640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.909770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.909851] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17977c57-821a-4911-a482-c647fb3f67ce already deleted. [ 717.909935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17977c57-821a-4911-a482-c647fb3f67ce" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.152317] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cca985d3-50ed-4d4a-9108-1b1fcfface62 [ 718.152700] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.153609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.153609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.153609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.153609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.153609] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cca985d3-50ed-4d4a-9108-1b1fcfface62 already deleted. [ 718.153609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cca985d3-50ed-4d4a-9108-1b1fcfface62" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.169753] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddca1a7a-8b2a-45ad-be87-40bff37f6582 req-ec5e60f9-b775-4916-a1ba-8489346d9cea service nova] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_rules [ 718.169753] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddca1a7a-8b2a-45ad-be87-40bff37f6582 req-ec5e60f9-b775-4916-a1ba-8489346d9cea service nova] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 718.169951] env[65162]: INFO networking_nsxv3.common.synchronization [req-ddca1a7a-8b2a-45ad-be87-40bff37f6582 req-ec5e60f9-b775-4916-a1ba-8489346d9cea service nova] Enqueued Resource ID: 2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 with Priority: HIGHEST for action port [ 718.171958] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_rules [ 718.172222] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 718.172297] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 with Priority: HIGHEST for action port [ 718.172538] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.172662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.172725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.173020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.173096] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.177398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.179111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.179111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.180209] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.181151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.181279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.181336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.184828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.184828] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2da6c8b5-5dbe-4e15-8fa2-06bb6d849064',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.384513] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.384767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.384951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.385263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.385365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.385672] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.385834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.385929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.386246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.386319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.386453] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 already deleted. [ 718.386574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.468525] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.468525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.468525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.469275] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.469658] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.469992] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.470244] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.471346] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.471614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.471961] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.472202] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.472416] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.474663] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.474663] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.474663] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.474663] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.499231] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.499417] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.499513] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.499686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.499991] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-86d3d920-0424-4169-b273-1b0f4ecd51bc taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.500171] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.500284] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.501311] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.501311] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d3d920-0424-4169-b273-1b0f4ecd51bc',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.683651] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.686021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.686021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.686021] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 with status ACTIVE [ 718.686021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.686021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.686021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.686021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.686021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.686418] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.686418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.686418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.686418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.686529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.686613] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.686699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.686763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.686896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.686963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.687258] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2da6c8b5-5dbe-4e15-8fa2-06bb6d849064 is going to be updated. [ 718.714564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.715708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.715799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.716079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.716182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.716355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2da6c8b5-5dbe-4e15-8fa2-06bb6d849064" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.005679] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.005679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.006094] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.006180] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.006398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.006630] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 86d3d920-0424-4169-b273-1b0f4ecd51bc not found, creating... [ 719.007675] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.007675] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.007675] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.007873] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.008061] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.008515] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.008745] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.008938] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.009356] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.009486] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.009705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 86d3d920-0424-4169-b273-1b0f4ecd51bc is going to be created. [ 719.041145] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.041145] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.041145] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.041359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.042080] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.042080] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.190577] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.693937] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.694139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.694636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.694636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.694636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.694636] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be created. [ 719.727869] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.727869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.727869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.727869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.729231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.739112] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: UNINITIALIZED for 2s [ 719.805149] env[65162]: INFO networking_nsxv3.common.synchronization [req-9075ee6b-4161-4db2-b9ff-15d20a56647e req-e7ef7786-e11c-4992-bc9f-f35b9c0c9d96 service nova] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_rules [ 719.805362] env[65162]: INFO networking_nsxv3.common.synchronization [req-9075ee6b-4161-4db2-b9ff-15d20a56647e req-e7ef7786-e11c-4992-bc9f-f35b9c0c9d96 service nova] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_members [ 719.805455] env[65162]: INFO networking_nsxv3.common.synchronization [req-9075ee6b-4161-4db2-b9ff-15d20a56647e req-e7ef7786-e11c-4992-bc9f-f35b9c0c9d96 service nova] Enqueued Resource ID: 86d3d920-0424-4169-b273-1b0f4ecd51bc with Priority: HIGHEST for action port [ 719.805988] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_rules [ 719.806184] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_members [ 719.806282] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86d3d920-0424-4169-b273-1b0f4ecd51bc with Priority: HIGHEST for action port [ 719.806609] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.806675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.806764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.806935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.809563] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.811404] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.811545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.811688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.812049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.812112] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.812194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.812256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.812406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.812519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.812597] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.819336] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-86d3d920-0424-4169-b273-1b0f4ecd51bc taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.819336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.819336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.819336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.819336] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d3d920-0424-4169-b273-1b0f4ecd51bc',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.323133] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.323133] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.323133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.323133] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86d3d920-0424-4169-b273-1b0f4ecd51bc with status ACTIVE [ 720.324321] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.329777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.329777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.329777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.329777] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86d3d920-0424-4169-b273-1b0f4ecd51bc is going to be updated. [ 720.359333] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.359333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.359333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.359523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.359662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.359822] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86d3d920-0424-4169-b273-1b0f4ecd51bc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.369225] env[65162]: INFO networking_nsxv3.common.synchronization [None req-7201918e-53c9-4704-a27c-24528bd99b94 None None] Enqueued Resource ID: 299e4f64-5be9-4a92-a4a8-21bac7981236 with Priority: HIGHEST for action port [ 720.370294] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 299e4f64-5be9-4a92-a4a8-21bac7981236 with Priority: HIGHEST for action port [ 720.370899] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-299e4f64-5be9-4a92-a4a8-21bac7981236 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.371033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-299e4f64-5be9-4a92-a4a8-21bac7981236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.371033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-299e4f64-5be9-4a92-a4a8-21bac7981236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.371533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-299e4f64-5be9-4a92-a4a8-21bac7981236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.371702] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('299e4f64-5be9-4a92-a4a8-21bac7981236',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.576424] env[65162]: INFO networking_nsxv3.common.synchronization [req-4d03be08-887b-4637-bacd-6fc5f645a3b9 req-b28b735a-f20c-4a87-b5f8-99a7f57d16b5 tempest-ServersNegativeTestJSON-1754726929 tempest-ServersNegativeTestJSON-1754726929-project-member] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 720.577042] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 720.577460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.577605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.577605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.577848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.578023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.578176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.578176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.578337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.578422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.578515] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.012778] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.012778] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 299e4f64-5be9-4a92-a4a8-21bac7981236 [ 721.012778] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.012778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.012778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.012778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.012778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.012778] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:299e4f64-5be9-4a92-a4a8-21bac7981236 already deleted. [ 721.012778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-299e4f64-5be9-4a92-a4a8-21bac7981236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.081747] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.081747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.081747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.081747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.082078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.082078] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.082165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.082198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.082341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.082418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.082501] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d already deleted. [ 721.082582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.322953] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.323215] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.323637] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.323808] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.324129] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.324322] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.325201] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.325201] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.325201] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.325201] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.325201] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.325384] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.325384] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.325522] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.325683] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.325935] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.351345] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.351345] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.351345] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.351345] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.351345] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-7f443da1-15c5-47e2-887d-0dcb6d2ea209 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.351345] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.351345] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.351963] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.352390] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f443da1-15c5-47e2-887d-0dcb6d2ea209',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.513900] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.514558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.514558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.514558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.514871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.514871] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 is going to be created. [ 721.551294] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.551294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.551294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.551294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.551294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.562775] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 in Status: UNINITIALIZED for 2s [ 721.751452] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 721.751452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.751655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.751982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.752289] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.752523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.752629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.752890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.752992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.753157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.753295] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.856992] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.857278] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.857473] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.857776] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.857934] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.858118] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 7f443da1-15c5-47e2-887d-0dcb6d2ea209 not found, creating... [ 721.858429] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.858599] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.858712] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.858958] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.859120] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.859417] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.859586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.859692] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.859896] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.860035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.860260] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 is going to be created. [ 721.884589] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.884816] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.884928] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.885247] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.885624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.885875] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.260667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.260667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.260667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.260667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.260667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.261479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.261479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.261479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.261479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.261479] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.702065] env[65162]: INFO networking_nsxv3.common.synchronization [req-4d03be08-887b-4637-bacd-6fc5f645a3b9 req-614f7b8c-a17c-462f-9c2c-60c59a474b1a service nova] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_rules [ 722.702065] env[65162]: INFO networking_nsxv3.common.synchronization [req-4d03be08-887b-4637-bacd-6fc5f645a3b9 req-614f7b8c-a17c-462f-9c2c-60c59a474b1a service nova] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 722.702065] env[65162]: INFO networking_nsxv3.common.synchronization [req-4d03be08-887b-4637-bacd-6fc5f645a3b9 req-614f7b8c-a17c-462f-9c2c-60c59a474b1a service nova] Enqueued Resource ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 with Priority: HIGHEST for action port [ 722.702065] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_rules [ 722.702065] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 722.702065] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 with Priority: HIGHEST for action port [ 722.702065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.702065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.702065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.702065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.702065] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.703471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.703471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.703471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.703471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.703471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.704765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.704765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.704765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.704765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.704765] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.705984] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f443da1-15c5-47e2-887d-0dcb6d2ea209 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.705984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.705984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.707127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.707695] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f443da1-15c5-47e2-887d-0dcb6d2ea209',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.763453] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f: rpc.has_security_group_logging(os_id): False [ 722.783682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.783874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.783874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.784117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.784231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.784463] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.784562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.784659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.784789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.784873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.785077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.785191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.785222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.785362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.785438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.785615] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.785705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.785766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.785908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.785982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.786089] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be created. [ 722.888358] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.888579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.888579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.889696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.889696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.908485] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: IN_PROGRESS for 2s [ 723.150337] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ffcea3a7-ab2b-4964-bff7-6f8a0ed36a1a tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_rules [ 723.151028] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_rules [ 723.152180] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.152312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.152383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.152638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.152723] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.211329] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.211329] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.211329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.211631] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f443da1-15c5-47e2-887d-0dcb6d2ea209 with status ACTIVE [ 723.211631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.211631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.211792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.212110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.212110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.212212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.212352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.212352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.212506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.212578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.212753] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.212836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.212896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.213110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.213197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.213280] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 is going to be updated. [ 723.238985] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.238985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.239145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.239286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.239429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.239585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.328660] env[65162]: INFO networking_nsxv3.common.synchronization [None req-de5f1746-b718-4b75-b51f-599cad78c428 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_rules [ 723.330050] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_rules [ 723.330050] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.330358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.576409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 in Status: SUCCESS [ 723.576623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.576786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.576999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.577228] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.577717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.577717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.577717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.577717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.577717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.577948] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.679623] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.679960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.680143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.680477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.680677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.680850] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 already deleted. [ 723.681046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.681287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.681542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.681704] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.709252] env[65162]: INFO networking_nsxv3.common.synchronization [req-b25bc415-72c7-40cc-a09d-20693b27ac40 req-81f9ccd2-798b-4b88-ada6-8ae0c91632ef tempest-ListImageFiltersTestJSON-70258688 tempest-ListImageFiltersTestJSON-70258688-project-member] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 723.712025] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 723.712025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.712025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.712025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.712025] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.716824] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.087228] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.207394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.207394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.207394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.207394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.207394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.208061] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 already deleted. [ 724.208269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.214739] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.218552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.218705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.218772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.219012] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.219111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.219221] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be created. [ 724.247672] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.247672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.247997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.248322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.248531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.260324] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: UNINITIALIZED for 2s [ 724.589629] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5: rpc.has_security_group_logging(os_id): False [ 724.612628] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.612891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.612891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.613186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.613299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.613552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.613698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.613698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.614060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.614060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.614311] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 is going to be created. [ 724.644328] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.644465] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.644554] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.644829] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.645118] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.645276] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.645388] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.645598] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.645737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.645941] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.646059] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.646183] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.646285] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.646478] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.646478] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.646593] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.669424] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.669694] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.669941] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.670261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.670728] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.670988] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.671142] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.671522] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.671692] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4231b30-cf18-4a4c-b42b-bfaf938f8f97',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.699405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.699584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.699651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.699893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.700047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.718914] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.719912] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 in Status: IN_PROGRESS for 2s [ 724.946382] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 724.946382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.088078] env[65162]: INFO networking_nsxv3.common.synchronization [None req-460e95ba-2a02-4c72-aca5-22519fc0e881 None None] Enqueued Resource ID: 5084d74a-a736-4a6f-baf8-fdbc018fca1d with Priority: HIGHEST for action port [ 725.088920] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5084d74a-a736-4a6f-baf8-fdbc018fca1d with Priority: HIGHEST for action port [ 725.089481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5084d74a-a736-4a6f-baf8-fdbc018fca1d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.090423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5084d74a-a736-4a6f-baf8-fdbc018fca1d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.094259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5084d74a-a736-4a6f-baf8-fdbc018fca1d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.094259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5084d74a-a736-4a6f-baf8-fdbc018fca1d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.094259] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5084d74a-a736-4a6f-baf8-fdbc018fca1d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.174785] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.174785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.174785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.175408] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.175611] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.175899] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port d4231b30-cf18-4a4c-b42b-bfaf938f8f97 not found, creating... [ 725.181324] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.181324] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.181324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.181791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: d4231b30-cf18-4a4c-b42b-bfaf938f8f97 is going to be created. [ 725.214978] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.214978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.214978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.214978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.214978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.214978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.220314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.220746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.220983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.221314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.223744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.223744] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be updated. [ 725.331072] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.331072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.331072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.331072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.331072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.356011] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: IN_PROGRESS for 2s [ 725.595195] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5084d74a-a736-4a6f-baf8-fdbc018fca1d [ 725.595297] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.595353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.595424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.595766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.595886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.595974] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5084d74a-a736-4a6f-baf8-fdbc018fca1d already deleted. [ 725.596083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5084d74a-a736-4a6f-baf8-fdbc018fca1d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.995409] env[65162]: INFO networking_nsxv3.common.synchronization [req-b25bc415-72c7-40cc-a09d-20693b27ac40 req-3b75b5b4-beb3-40f7-b395-e0654ae69880 service nova] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_rules [ 725.995708] env[65162]: INFO networking_nsxv3.common.synchronization [req-b25bc415-72c7-40cc-a09d-20693b27ac40 req-3b75b5b4-beb3-40f7-b395-e0654ae69880 service nova] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 725.995745] env[65162]: INFO networking_nsxv3.common.synchronization [req-b25bc415-72c7-40cc-a09d-20693b27ac40 req-3b75b5b4-beb3-40f7-b395-e0654ae69880 service nova] Enqueued Resource ID: d4231b30-cf18-4a4c-b42b-bfaf938f8f97 with Priority: HIGHEST for action port [ 725.996295] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_rules [ 725.996431] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 725.996584] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4231b30-cf18-4a4c-b42b-bfaf938f8f97 with Priority: HIGHEST for action port [ 725.996808] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.996937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.997315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.997581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.997948] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.999459] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.999578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.999786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.999924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.999968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.000152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.000244] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4231b30-cf18-4a4c-b42b-bfaf938f8f97',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.273504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 726.273832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.274078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.274441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.274734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.274903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.275053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.275304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.275578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.275767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.275767] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.450874] env[65162]: INFO networking_nsxv3.common.synchronization [req-1491d714-5928-4804-a6df-318fe42b913d req-931dfe10-3ea1-42a9-8d9c-2c49d58fb18e tempest-FloatingIPsAssociationTestJSON-1766689371 tempest-FloatingIPsAssociationTestJSON-1766689371-project-member] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 726.452012] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGHEST for action security_group_members [ 726.456026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.456026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.456026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.456026] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.507808] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4231b30-cf18-4a4c-b42b-bfaf938f8f97 with status ACTIVE [ 726.507808] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.507916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.507916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.508205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.509554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.509554] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.512147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.512268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.512499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.512598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.512830] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.512967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.513063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.513251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.513342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.513433] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4231b30-cf18-4a4c-b42b-bfaf938f8f97 is going to be updated. [ 726.514701] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.514809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.553264] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.553264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.553264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.553535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.553535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.553677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4231b30-cf18-4a4c-b42b-bfaf938f8f97" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.743154] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 in Status: SUCCESS [ 726.743154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.783072] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.783383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.783383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.783569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.784408] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.784595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.784682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.784944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.785128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.785684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.785684] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.785903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.786023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.786443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.786443] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.786443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.786573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.787034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.787034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.787135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.787332] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.958234] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.958427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.958646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.958936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.959083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.959328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.959474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.959588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.959875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.959875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.960150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be updated. [ 726.997128] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.997472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.997472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.997684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.997769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.009317] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: IN_PROGRESS for 2s [ 727.309498] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9998726b-c2cc-495a-9b94-43b9da32545d: rpc.has_security_group_logging(os_id): False [ 727.331682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.331682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.331682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.331682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.333132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.333132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.334038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.334236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.334496] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.334651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.334758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.334945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.335093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.335266] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be created. [ 727.340356] env[65162]: INFO networking_nsxv3.common.synchronization [req-85214441-65ee-4d44-bde9-b1b829eca662 req-b16047b9-e436-4ece-9b53-a60376e7640e tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 727.341227] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 727.341573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.341728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.341836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.342364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.342364] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.342507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.342542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.344362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.344491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.348019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.374179] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 727.374414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.374689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.374981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.375211] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.375348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.375435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.375600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.375681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.375786] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.411965] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.415266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.415442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.415785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.416884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.433274] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 727.856604] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.856604] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.856604] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e already deleted. [ 727.856604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.883727] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.226025] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.226025] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.226025] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.230024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.230024] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.230024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.230024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.230024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.230024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.230024] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.230024] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.230024] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.230024] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.230024] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.230024] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.230024] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.270409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.270409] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.270409] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.270409] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.270409] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.270409] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.270409] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.270409] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.270409] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c0cbbb4-6dc2-44b7-b568-37f23cd4980b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.387040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.415846] env[65162]: INFO networking_nsxv3.common.synchronization [None req-a61779a9-7fc4-4778-bfec-740bf3012742 None None] Enqueued Resource ID: 183d87f1-8ae8-466b-9d8a-da3acc918b01 with Priority: HIGHEST for action port [ 728.416706] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183d87f1-8ae8-466b-9d8a-da3acc918b01 with Priority: HIGHEST for action port [ 728.417086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-183d87f1-8ae8-466b-9d8a-da3acc918b01 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.417217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-183d87f1-8ae8-466b-9d8a-da3acc918b01" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.417285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-183d87f1-8ae8-466b-9d8a-da3acc918b01" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.417683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-183d87f1-8ae8-466b-9d8a-da3acc918b01" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.417759] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('183d87f1-8ae8-466b-9d8a-da3acc918b01',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.776491] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.776491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.776491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.776491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.776491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.776491] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 7c0cbbb4-6dc2-44b7-b568-37f23cd4980b not found, creating... [ 728.776491] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.776491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.776491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.777215] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.777215] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.777272] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.777600] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.777877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.778050] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.778217] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.778416] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 7c0cbbb4-6dc2-44b7-b568-37f23cd4980b is going to be created. [ 728.802063] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.802308] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.802476] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.802794] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.803017] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.803271] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.892958] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.892958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.892958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.892958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.892958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.892958] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be updated. [ 728.921986] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 183d87f1-8ae8-466b-9d8a-da3acc918b01 [ 728.922264] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.922399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.922472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.922684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.922778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.922874] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:183d87f1-8ae8-466b-9d8a-da3acc918b01 already deleted. [ 728.922961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-183d87f1-8ae8-466b-9d8a-da3acc918b01" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.958097] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.958317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.958364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.958583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.958842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.977633] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: IN_PROGRESS for 2s [ 729.020826] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff in Status: SUCCESS [ 729.020826] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff deletion is rescheduled due to dependency. [ 729.020826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.250279] env[65162]: INFO networking_nsxv3.common.synchronization [None req-29f789d6-605e-43b9-aff9-351d635773df None None] Enqueued Resource ID: 61fbfc82-301e-4853-84ab-3d942646b777 with Priority: HIGHEST for action port [ 729.250824] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fbfc82-301e-4853-84ab-3d942646b777 with Priority: HIGHEST for action port [ 729.251612] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-61fbfc82-301e-4853-84ab-3d942646b777 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.251771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61fbfc82-301e-4853-84ab-3d942646b777" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.251831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61fbfc82-301e-4853-84ab-3d942646b777" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.252076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61fbfc82-301e-4853-84ab-3d942646b777" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.252381] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61fbfc82-301e-4853-84ab-3d942646b777',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.448505] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 729.448860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.617305] env[65162]: INFO networking_nsxv3.common.synchronization [req-85214441-65ee-4d44-bde9-b1b829eca662 req-677d9268-5210-44e4-b26b-11332e91af7c service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 729.617305] env[65162]: INFO networking_nsxv3.common.synchronization [req-85214441-65ee-4d44-bde9-b1b829eca662 req-677d9268-5210-44e4-b26b-11332e91af7c service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 729.617305] env[65162]: INFO networking_nsxv3.common.synchronization [req-85214441-65ee-4d44-bde9-b1b829eca662 req-677d9268-5210-44e4-b26b-11332e91af7c service nova] Enqueued Resource ID: 7c0cbbb4-6dc2-44b7-b568-37f23cd4980b with Priority: HIGHEST for action port [ 729.617305] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 729.617502] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 729.617502] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c0cbbb4-6dc2-44b7-b568-37f23cd4980b with Priority: HIGHEST for action port [ 729.617703] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.617824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.617889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.618181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.618265] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.620069] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.620069] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.620069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.620069] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.621064] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.621064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.621064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.621203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.621967] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c0cbbb4-6dc2-44b7-b568-37f23cd4980b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.757757] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61fbfc82-301e-4853-84ab-3d942646b777 [ 729.758185] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.758404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.758514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.758824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.759016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.759225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61fbfc82-301e-4853-84ab-3d942646b777 already deleted. [ 729.759305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61fbfc82-301e-4853-84ab-3d942646b777" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.123537] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.123772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.127369] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.128378] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c0cbbb4-6dc2-44b7-b568-37f23cd4980b with status ACTIVE [ 730.128596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.128745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.128821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.129070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.129398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.129398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.129567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.129567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.129657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.129724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.129887] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.129977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.130917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.131573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.131672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.131818] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c0cbbb4-6dc2-44b7-b568-37f23cd4980b is going to be updated. [ 730.172325] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.172526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.172571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.172796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.172941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.173151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c0cbbb4-6dc2-44b7-b568-37f23cd4980b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.252436] env[65162]: INFO networking_nsxv3.common.synchronization [req-23ed560d-c135-4d6a-b3d6-4a75d3cbb2a3 req-411d44cd-8066-4061-a9e0-e5fa80cb7f91 tempest-ServersWithSpecificFlavorTestJSON-515804645 tempest-ServersWithSpecificFlavorTestJSON-515804645-project-member] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 730.253362] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 730.253607] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.253751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.253868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.254101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.254256] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.254369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.254445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.254621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.254731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.254849] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.634831] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.757561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.757757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.757979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.758090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.758172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.758407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.758532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.758598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.758780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.761445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.761445] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be updated. [ 730.797286] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.797441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.797509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.798633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.798807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.811400] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 730.845671] env[65162]: INFO networking_nsxv3.common.synchronization [req-63c2ca91-6627-48f9-9ded-2717ef14a4a6 req-3a14fd93-5c3a-4f63-ab3d-0a180d34d8e8 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 730.846294] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 730.846596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.846722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.846789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.850282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.851558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.851558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.851558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.851558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.851558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.851558] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.988493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 730.988823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.990344] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.990344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.990344] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.137433] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.137586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.137676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.137905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.138516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.138516] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be created. [ 731.166194] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.166194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.166194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.166194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.166194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.176069] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: UNINITIALIZED for 2s [ 731.355117] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.355117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.355117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.355117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.355117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.357357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.357571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.357663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.357906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.358008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.358115] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 already deleted. [ 731.358220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.496706] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.496706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.497467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.497467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.497467] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.497467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.497467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.498159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.498159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.498159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.498159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.498159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.498159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.498351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.498351] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.498634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.498634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.498634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.498955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.498955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.498955] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.562979] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.563205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.563304] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.563683] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.563974] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.564136] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.564242] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.564456] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.564587] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.564776] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.565196] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.565196] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.565196] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.565196] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.565352] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.565432] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.586172] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.586352] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.586464] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.587355] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.587355] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-9688885e-65a6-418f-b16e-8a287bbee070 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.587559] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.587703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.588096] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.588322] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9688885e-65a6-418f-b16e-8a287bbee070',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.003753] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f: rpc.has_security_group_logging(os_id): False [ 732.030378] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.030567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.030699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.030936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.031082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.031329] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.031487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.031593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.031830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.031922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.032748] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.032877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.032959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.033174] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.033283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.033623] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.033748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.033851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.034049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.034283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.034837] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be updated. [ 732.094772] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.094949] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.095069] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.095385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.095531] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.095679] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 9688885e-65a6-418f-b16e-8a287bbee070 not found, creating... [ 732.096062] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.096205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.096274] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.096490] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.096638] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.097009] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.097182] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.097296] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.097528] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.097673] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.097877] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 9688885e-65a6-418f-b16e-8a287bbee070 is going to be created. [ 732.111130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.111306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.111414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.111712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.113111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.123048] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.123280] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.123683] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.123683] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.123948] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.124243] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.125745] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: IN_PROGRESS for 2s [ 732.350220] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c2e6ce25-f243-4841-8c77-006debd7c240 None None] Enqueued Resource ID: df0ce2c8-5399-452d-a2e6-85a8bcc60313 with Priority: HIGHEST for action port [ 732.351964] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ce2c8-5399-452d-a2e6-85a8bcc60313 with Priority: HIGHEST for action port [ 732.351964] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0ce2c8-5399-452d-a2e6-85a8bcc60313 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.351964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0ce2c8-5399-452d-a2e6-85a8bcc60313" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.351964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0ce2c8-5399-452d-a2e6-85a8bcc60313" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.354328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0ce2c8-5399-452d-a2e6-85a8bcc60313" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.354328] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ce2c8-5399-452d-a2e6-85a8bcc60313',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.823902] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 732.824807] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db deletion is rescheduled due to dependency. [ 732.824807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.860430] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df0ce2c8-5399-452d-a2e6-85a8bcc60313 [ 732.860671] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.861100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.861193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.861350] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df0ce2c8-5399-452d-a2e6-85a8bcc60313 already deleted. [ 732.861421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0ce2c8-5399-452d-a2e6-85a8bcc60313" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.946102] env[65162]: INFO networking_nsxv3.common.synchronization [req-63c2ca91-6627-48f9-9ded-2717ef14a4a6 req-3d9a17a9-b457-4b64-ab46-298c19d1e7fe service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 732.946529] env[65162]: INFO networking_nsxv3.common.synchronization [req-63c2ca91-6627-48f9-9ded-2717ef14a4a6 req-3d9a17a9-b457-4b64-ab46-298c19d1e7fe service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 732.946680] env[65162]: INFO networking_nsxv3.common.synchronization [req-63c2ca91-6627-48f9-9ded-2717ef14a4a6 req-3d9a17a9-b457-4b64-ab46-298c19d1e7fe service nova] Enqueued Resource ID: 9688885e-65a6-418f-b16e-8a287bbee070 with Priority: HIGHEST for action port [ 732.948043] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 732.948043] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 732.948043] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9688885e-65a6-418f-b16e-8a287bbee070 with Priority: HIGHEST for action port [ 732.948255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.948386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.948452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.948790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.948937] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.950567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.951503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.951982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.951982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.952103] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.952176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.952226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.952368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.952770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.952770] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.953732] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9688885e-65a6-418f-b16e-8a287bbee070 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.953897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.954322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.954541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.954926] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9688885e-65a6-418f-b16e-8a287bbee070',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.190701] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 733.191040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.191364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.191562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.191793] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.191981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.192197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.192265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.192326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.192460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.192791] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.427869] env[65162]: INFO networking_nsxv3.common.synchronization [req-183cefae-971d-4b04-8b6e-df080e10b59c req-71f98822-8054-4571-bd81-3c09fbc5b4e5 tempest-ServersTestBootFromVolume-331407756 tempest-ServersTestBootFromVolume-331407756-project-member] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_members [ 733.428739] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_members [ 733.431116] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.432639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.432639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.434048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.434048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.434048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.434048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.434048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.434048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.436043] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.458485] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.459293] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.459448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.459603] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9688885e-65a6-418f-b16e-8a287bbee070 with status ACTIVE [ 733.459741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.459846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.462189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.462646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.464417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.464547] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.464736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.464853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.465618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.465618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.465618] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.465764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.465876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.466134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.466220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.466350] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9688885e-65a6-418f-b16e-8a287bbee070 is going to be updated. [ 733.495826] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.496039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.496166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.497794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.498023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.498274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9688885e-65a6-418f-b16e-8a287bbee070" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.696041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.696041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.696041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.696041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.697237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.697421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.697524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.697772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.697912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.698308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.698473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.698572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.698632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.698786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.699017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.699017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.699124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.699207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.699277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.699353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.699439] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.891920] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.892272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-28" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.892272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-28" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.892789] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-28" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.892897] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.896907] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.897155] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.897568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.897932] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.898096] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.898760] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.898935] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.899075] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.899209] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.899386] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.899698] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.930419] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.930660] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.930854] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.931118] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-28" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.931569] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-a647f853-bb1c-4dfb-8565-caed821e4b37 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.931795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.931980] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.932379] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.932553] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a647f853-bb1c-4dfb-8565-caed821e4b37',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.937347] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.937347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.937456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.937616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.937705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.937892] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.937990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.938065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.938213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.944026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.944026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 already deleted. [ 733.944026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.973033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.150438] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 734.150752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.201905] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55eb5d3-a252-4f36-9046-1505d8f8fa4e: rpc.has_security_group_logging(os_id): False [ 734.221517] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.221729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.221795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.221997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.222190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.222460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.222657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.222758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.222983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.223121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.223809] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.223809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.223809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.223809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.223809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.224050] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.224106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.224818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.224818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.224818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.224995] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be created. [ 734.293961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.294183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.294236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.294491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.294729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.310913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 734.437066] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.437353] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.437493] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.437827] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.437986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.438169] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port a647f853-bb1c-4dfb-8565-caed821e4b37 not found, creating... [ 734.438445] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.438605] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.438718] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.438965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.439114] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.439409] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.439665] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.439665] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.439905] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.442088] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.442088] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: a647f853-bb1c-4dfb-8565-caed821e4b37 is going to be created. [ 734.473409] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.473640] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.473640] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.474462] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.474462] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.475786] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.476650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.476650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.476650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.476650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.476650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.476650] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be created. [ 734.527605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.527769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.527824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.528083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.528362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.549566] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: UNINITIALIZED for 2s [ 735.214680] env[65162]: INFO networking_nsxv3.common.synchronization [req-183cefae-971d-4b04-8b6e-df080e10b59c req-5093b346-8878-4f49-a617-cc24bef42989 service nova] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_rules [ 735.223748] env[65162]: INFO networking_nsxv3.common.synchronization [req-183cefae-971d-4b04-8b6e-df080e10b59c req-5093b346-8878-4f49-a617-cc24bef42989 service nova] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_members [ 735.224083] env[65162]: INFO networking_nsxv3.common.synchronization [req-183cefae-971d-4b04-8b6e-df080e10b59c req-5093b346-8878-4f49-a617-cc24bef42989 service nova] Enqueued Resource ID: a647f853-bb1c-4dfb-8565-caed821e4b37 with Priority: HIGHEST for action port [ 735.228220] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_rules [ 735.228220] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_members [ 735.228220] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a647f853-bb1c-4dfb-8565-caed821e4b37 with Priority: HIGHEST for action port [ 735.228220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.228220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.228220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.228220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.228220] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.228220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.228220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.228841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.229051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.232377] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.232377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.232377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.232377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.232377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.232377] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.234254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a647f853-bb1c-4dfb-8565-caed821e4b37 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.234428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.234518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.234793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.234891] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a647f853-bb1c-4dfb-8565-caed821e4b37',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.738455] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.738455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.738455] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.740014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a647f853-bb1c-4dfb-8565-caed821e4b37 with status ACTIVE [ 735.740328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.740491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.740564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.740853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.740998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.746044] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.746312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.746500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.746835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.747034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.747383] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.747536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.747606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.747833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.747939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.748064] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a647f853-bb1c-4dfb-8565-caed821e4b37 is going to be updated. [ 735.778242] env[65162]: INFO networking_nsxv3.common.synchronization [req-c32fbbeb-961c-4faa-983e-7f87b583bd8c req-a455d9d7-56d0-4347-9420-d6068a67febe tempest-ImagesOneServerTestJSON-99976462 tempest-ImagesOneServerTestJSON-99976462-project-member] Enqueued Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_members [ 735.779684] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGHEST for action security_group_members [ 735.779684] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.779948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.779948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.780297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.780604] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.782036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.782036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.782036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.782036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.782036] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.800567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.800693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.800764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.801739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.802019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.802265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a647f853-bb1c-4dfb-8565-caed821e4b37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.252282] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.286464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.286666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.286732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.286956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.287074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.287438] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.287582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.287657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.287850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.287985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.288159] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17b2580d-282c-4150-9de0-918d31fd8103 is going to be updated. [ 736.347497] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 736.347794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.368558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.368758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.369103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.369179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.369665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.382684] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17b2580d-282c-4150-9de0-918d31fd8103 in Status: IN_PROGRESS for 2s [ 736.437442] env[65162]: INFO networking_nsxv3.common.synchronization [req-5df68509-ebc2-444b-a555-a2d8e86e20df req-13562f7a-026e-4f26-9465-78f122e7e869 tempest-ServersAdminNegativeTestJSON-1297608031 tempest-ServersAdminNegativeTestJSON-1297608031-project-member] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 736.438162] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 736.438545] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.438721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.438781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.439096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.439261] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.439380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.439467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.439651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.439763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.439902] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.563245] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.563245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.563245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.563245] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.757315] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.757315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.757315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.757315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.757315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.757315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 is going to be created. [ 736.787816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.788286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.788469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.788796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.789076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802206] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: UNINITIALIZED for 2s [ 736.929266] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.929576] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.930412] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.930412] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.930527] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.930704] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.930848] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.931260] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.931473] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.931944] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.932128] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.932308] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.932454] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.932774] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.933077] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.933264] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.941997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.942184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.942258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.942922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.942922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.942922] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.942922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.942922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.943153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.943153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.943205] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d already deleted. [ 736.943254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.956216] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.956393] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.956530] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.956701] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.957049] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-892b004a-36aa-4d9e-856d-471b91f7885c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.957290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.957420] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.957757] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.957908] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('892b004a-36aa-4d9e-856d-471b91f7885c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.066325] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.066635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.066635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.066860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.067072] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.067215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.067299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.067524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.067675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.067831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.068166] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.068391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.068488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.068647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.068798] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.068911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.068985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.069118] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.069204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.069375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.069532] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.461145] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.461799] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.461799] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.461799] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.461947] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.462129] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 892b004a-36aa-4d9e-856d-471b91f7885c not found, creating... [ 737.462411] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.462624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.462751] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.462979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.463132] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.463456] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.463622] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.463686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.463997] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.464160] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.464289] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 892b004a-36aa-4d9e-856d-471b91f7885c is going to be created. [ 737.488754] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.488972] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.489123] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.489461] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.489740] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.490024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.572293] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 542ab4ea-1934-47eb-b35d-a11a9e723c30: rpc.has_security_group_logging(os_id): False [ 737.603070] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.603253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.603347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.603683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.603683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.603847] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.603984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.604053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.604192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.604272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.604461] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.604558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.604620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.604762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.604847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.605053] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.605165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.605219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.605350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.605425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.605521] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be created. [ 737.720079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.720199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.720281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.722031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.722031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.735526] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 738.214508] env[65162]: INFO networking_nsxv3.common.synchronization [req-5df68509-ebc2-444b-a555-a2d8e86e20df req-cd734646-168c-47bb-8846-414b9c08fafb service nova] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_rules [ 738.214508] env[65162]: INFO networking_nsxv3.common.synchronization [req-5df68509-ebc2-444b-a555-a2d8e86e20df req-cd734646-168c-47bb-8846-414b9c08fafb service nova] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 738.214508] env[65162]: INFO networking_nsxv3.common.synchronization [req-5df68509-ebc2-444b-a555-a2d8e86e20df req-cd734646-168c-47bb-8846-414b9c08fafb service nova] Enqueued Resource ID: 892b004a-36aa-4d9e-856d-471b91f7885c with Priority: HIGHEST for action port [ 738.214962] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_rules [ 738.215238] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 738.215550] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 892b004a-36aa-4d9e-856d-471b91f7885c with Priority: HIGHEST for action port [ 738.215858] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.215988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.216072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.216542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.216619] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.218567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.218689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.218757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.218944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.219141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.219241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.219299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.219441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.221040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.221040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.221040] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-892b004a-36aa-4d9e-856d-471b91f7885c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.221040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.221040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.221040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.221040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('892b004a-36aa-4d9e-856d-471b91f7885c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.395868] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17b2580d-282c-4150-9de0-918d31fd8103 in Status: SUCCESS [ 738.395868] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17b2580d-282c-4150-9de0-918d31fd8103 deletion is rescheduled due to dependency. [ 738.395868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.471673] env[65162]: INFO networking_nsxv3.common.synchronization [None req-615ede88-33f7-4f05-865c-1649487c70db None None] Enqueued Resource ID: 02a15ff2-e7da-48e3-a790-671209f7f035 with Priority: HIGHEST for action port [ 738.472329] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02a15ff2-e7da-48e3-a790-671209f7f035 with Priority: HIGHEST for action port [ 738.472638] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-02a15ff2-e7da-48e3-a790-671209f7f035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.472766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02a15ff2-e7da-48e3-a790-671209f7f035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.472849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02a15ff2-e7da-48e3-a790-671209f7f035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.473217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02a15ff2-e7da-48e3-a790-671209f7f035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.473373] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02a15ff2-e7da-48e3-a790-671209f7f035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.722910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.723180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.723267] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.724342] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 892b004a-36aa-4d9e-856d-471b91f7885c with status ACTIVE [ 738.724522] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.724644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.724713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.724969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.725105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.725295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.725397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.725458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.725675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.725777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.725986] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.726413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.726566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.726816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.727049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.727309] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 892b004a-36aa-4d9e-856d-471b91f7885c is going to be updated. [ 738.755143] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.755143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.755143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.756194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.756194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.756194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-892b004a-36aa-4d9e-856d-471b91f7885c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.827060] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: SUCCESS [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.827060] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.827060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.827060] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.975992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02a15ff2-e7da-48e3-a790-671209f7f035 [ 738.976819] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.976819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.976965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.977589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.977589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.977589] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02a15ff2-e7da-48e3-a790-671209f7f035 already deleted. [ 738.977589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02a15ff2-e7da-48e3-a790-671209f7f035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.230256] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.329686] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.734117] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.734533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.734533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.734643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.734689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.734776] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be created. [ 739.747493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 739.747716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.761793] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.762088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.762088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.762254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.762413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.950567] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: UNINITIALIZED for 2s [ 739.950567] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c367c1a-4f7d-4875-9d05-179a78da6584: rpc.has_security_group_logging(os_id): False [ 739.977614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.977854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.977854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.978080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.978168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.978447] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.978579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.978642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.978876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.979048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.979155] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 is going to be created. [ 740.110844] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.111077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.111571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.111820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.112133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.127159] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: IN_PROGRESS for 2s [ 740.664450] env[65162]: INFO networking_nsxv3.common.synchronization [req-3866511e-f744-473a-baa7-6fcd1572dc7b req-d5184c70-e8e9-46c1-be2a-480e0e69282d tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 740.665051] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 740.665379] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.666068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.666068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.666068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.666068] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.666068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.671055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.671055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.671055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.671055] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.173614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.173614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.173614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.173614] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be updated. [ 741.206979] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.207154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.207267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.208750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.208750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.221705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 741.253233] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-369 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.253837] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.254626] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.254984] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.255788] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.255993] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.256157] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.256463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.256692] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.256951] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.257106] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.257279] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.257523] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.257681] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.257816] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.258051] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.305799] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.306107] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.306783] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.306783] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.306985] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-a8adeb8e-57c2-480c-a05a-fd95ef574e49 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.307280] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.307584] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.307996] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.308209] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8adeb8e-57c2-480c-a05a-fd95ef574e49',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.427227] env[65162]: INFO networking_nsxv3.common.synchronization [None req-fb312893-5f4f-4fe9-a3e4-85e873fa9174 None None] Enqueued Resource ID: 1ed39417-1af1-48a1-96ea-6e6cd0a5bb75 with Priority: HIGHEST for action port [ 741.427574] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed39417-1af1-48a1-96ea-6e6cd0a5bb75 with Priority: HIGHEST for action port [ 741.427967] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ed39417-1af1-48a1-96ea-6e6cd0a5bb75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.428138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ed39417-1af1-48a1-96ea-6e6cd0a5bb75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.428227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ed39417-1af1-48a1-96ea-6e6cd0a5bb75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.428472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ed39417-1af1-48a1-96ea-6e6cd0a5bb75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.428558] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ed39417-1af1-48a1-96ea-6e6cd0a5bb75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.724895] env[65162]: INFO networking_nsxv3.common.synchronization [None req-84dc2e67-edbd-494e-8210-56c4237828ae None None] Enqueued Resource ID: 3235c590-4769-4599-8d12-bf8c9be0fc0f with Priority: HIGHEST for action port [ 741.725664] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3235c590-4769-4599-8d12-bf8c9be0fc0f with Priority: HIGHEST for action port [ 741.730118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-3235c590-4769-4599-8d12-bf8c9be0fc0f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.730358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3235c590-4769-4599-8d12-bf8c9be0fc0f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.730453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3235c590-4769-4599-8d12-bf8c9be0fc0f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.730792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3235c590-4769-4599-8d12-bf8c9be0fc0f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.730905] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3235c590-4769-4599-8d12-bf8c9be0fc0f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.811451] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.811451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.811451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.811451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.812085] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.812085] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port a8adeb8e-57c2-480c-a05a-fd95ef574e49 not found, creating... [ 741.812141] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.812317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.812444] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.812813] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.812945] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.813382] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.814065] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.814065] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.815241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.815241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.815241] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: a8adeb8e-57c2-480c-a05a-fd95ef574e49 is going to be created. [ 741.842475] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.842676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.842827] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.843330] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.843554] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.843805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.931944] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ed39417-1af1-48a1-96ea-6e6cd0a5bb75 [ 741.931944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.931944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.931944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.931944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.931944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.931944] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ed39417-1af1-48a1-96ea-6e6cd0a5bb75 already deleted. [ 741.931944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ed39417-1af1-48a1-96ea-6e6cd0a5bb75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.965029] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.965029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.965029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.965029] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.144062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: SUCCESS [ 742.144379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.234314] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3235c590-4769-4599-8d12-bf8c9be0fc0f [ 742.234616] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.234706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.234774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.235029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.235113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.235222] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3235c590-4769-4599-8d12-bf8c9be0fc0f already deleted. [ 742.235334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3235c590-4769-4599-8d12-bf8c9be0fc0f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.470025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.470025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.470025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.470708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.470708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.470708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470708] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.660038] env[65162]: INFO networking_nsxv3.common.synchronization [req-3866511e-f744-473a-baa7-6fcd1572dc7b req-1528d86b-a424-41e5-8994-d357538cde09 service nova] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_rules [ 742.660038] env[65162]: INFO networking_nsxv3.common.synchronization [req-3866511e-f744-473a-baa7-6fcd1572dc7b req-1528d86b-a424-41e5-8994-d357538cde09 service nova] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 742.660038] env[65162]: INFO networking_nsxv3.common.synchronization [req-3866511e-f744-473a-baa7-6fcd1572dc7b req-1528d86b-a424-41e5-8994-d357538cde09 service nova] Enqueued Resource ID: a8adeb8e-57c2-480c-a05a-fd95ef574e49 with Priority: HIGHEST for action port [ 742.660038] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_rules [ 742.660038] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 742.660038] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8adeb8e-57c2-480c-a05a-fd95ef574e49 with Priority: HIGHEST for action port [ 742.660038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.662331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.662331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.663038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.663038] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.663541] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.663649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.664193] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8adeb8e-57c2-480c-a05a-fd95ef574e49 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.664193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.664193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.666907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.667014] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8adeb8e-57c2-480c-a05a-fd95ef574e49',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.947189] env[65162]: INFO networking_nsxv3.common.synchronization [req-3a535f7a-a112-48cd-82fa-1f65061ba3dd req-e3dc3bad-c7c3-40ab-b897-51d697701443 tempest-InstanceActionsTestJSON-1626656935 tempest-InstanceActionsTestJSON-1626656935-project-member] Enqueued Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_members [ 742.948390] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76494ce4-3ed0-426c-ac36-271f9eef282c with Priority: HIGHEST for action security_group_members [ 742.948973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-76494ce4-3ed0-426c-ac36-271f9eef282c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.949233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.949314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.949523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.949680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.950109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.950230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.950399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.950528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.950991] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76494ce4-3ed0-426c-ac36-271f9eef282c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.974987] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcdff5a2-f30c-4336-a8cd-e116d208fd7d: rpc.has_security_group_logging(os_id): False [ 742.995260] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.995425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.995498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.995718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.995814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.996012] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.996157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.996266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.996475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.996563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.996762] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.996861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.996925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.998433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.998623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.998892] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.999009] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.999088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.999284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.001476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.001662] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be created. [ 743.077211] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.077211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.077211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.078054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.078305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.091169] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 743.170982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.171138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.171381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8adeb8e-57c2-480c-a05a-fd95ef574e49 with status ACTIVE [ 743.171505] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.171608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.171813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.171886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.172130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.172244] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.172305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.172305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.172456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.172557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.172702] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.172796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.172856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.172992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.173078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.173164] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8adeb8e-57c2-480c-a05a-fd95ef574e49 is going to be updated. [ 743.202648] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.202648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.202648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.202648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.202648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.203104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8adeb8e-57c2-480c-a05a-fd95ef574e49" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.235787] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 4s [ 743.427816] env[65162]: INFO networking_nsxv3.common.synchronization [req-08442e32-837b-40ec-a1ea-8fd4d559ffa4 req-021c60ad-40bb-49ec-8583-f466b1e389b3 tempest-MigrationsAdminTest-350875998 tempest-MigrationsAdminTest-350875998-project-member] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 743.428700] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 743.430220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.431606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.431967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.433599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.434286] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.434965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.434965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.435250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.435364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.435490] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.457254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.457657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.457657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.457853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.459179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.459179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.459179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.459179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.459179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.459179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.459179] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76494ce4-3ed0-426c-ac36-271f9eef282c is going to be updated. [ 743.492773] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.493142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.494139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.494307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.494696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.506315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76494ce4-3ed0-426c-ac36-271f9eef282c in Status: IN_PROGRESS for 2s [ 743.867947] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.868159] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.868262] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.868544] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.868754] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.868899] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.869011] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.869222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.869381] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.869582] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.869687] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.869786] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.869886] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.869986] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.870119] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.870214] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.891341] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.891538] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.891758] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.891851] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.892129] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-348aed1f-e5bc-4137-99b7-79cfddaf3061 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.892320] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.892443] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.892831] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.892912] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('348aed1f-e5bc-4137-99b7-79cfddaf3061',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.939384] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.217436] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b47cd72e-9e52-4f47-980d-e39c72d6a238 None None] Enqueued Resource ID: 026869e5-cb8d-4b4a-bb4c-c7a959050488 with Priority: HIGHEST for action port [ 744.217989] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 026869e5-cb8d-4b4a-bb4c-c7a959050488 with Priority: HIGHEST for action port [ 744.218431] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-026869e5-cb8d-4b4a-bb4c-c7a959050488 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.218431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-026869e5-cb8d-4b4a-bb4c-c7a959050488" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.218570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-026869e5-cb8d-4b4a-bb4c-c7a959050488" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.218761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-026869e5-cb8d-4b4a-bb4c-c7a959050488" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.218810] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('026869e5-cb8d-4b4a-bb4c-c7a959050488',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.396903] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.397276] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.397415] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.397809] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.398048] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.398292] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 348aed1f-e5bc-4137-99b7-79cfddaf3061 not found, creating... [ 744.398704] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.398940] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.401252] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.401252] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.401252] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.403889] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.404402] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.404629] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.405021] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.405277] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.405503] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 348aed1f-e5bc-4137-99b7-79cfddaf3061 is going to be created. [ 744.431747] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.432184] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.432332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.432765] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.433074] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.433786] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.442466] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.721820] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 026869e5-cb8d-4b4a-bb4c-c7a959050488 [ 744.721820] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.721820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.721820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.722139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.722139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.722139] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:026869e5-cb8d-4b4a-bb4c-c7a959050488 already deleted. [ 744.722249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-026869e5-cb8d-4b4a-bb4c-c7a959050488" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.946718] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.946900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.947162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.947782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.947782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.947782] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be updated. [ 745.012339] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.012602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.012602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.012757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.012902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.032705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 745.109626] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 745.109626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.161324] env[65162]: INFO networking_nsxv3.common.synchronization [req-08442e32-837b-40ec-a1ea-8fd4d559ffa4 req-323e3f44-bae7-4714-94d5-e98f9c20d598 service nova] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_rules [ 745.161324] env[65162]: INFO networking_nsxv3.common.synchronization [req-08442e32-837b-40ec-a1ea-8fd4d559ffa4 req-323e3f44-bae7-4714-94d5-e98f9c20d598 service nova] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 745.161970] env[65162]: INFO networking_nsxv3.common.synchronization [req-08442e32-837b-40ec-a1ea-8fd4d559ffa4 req-323e3f44-bae7-4714-94d5-e98f9c20d598 service nova] Enqueued Resource ID: 348aed1f-e5bc-4137-99b7-79cfddaf3061 with Priority: HIGHEST for action port [ 745.162278] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_rules [ 745.162619] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 745.162825] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 348aed1f-e5bc-4137-99b7-79cfddaf3061 with Priority: HIGHEST for action port [ 745.163479] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.163553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.163755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.163969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.164110] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.171973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.172151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.172586] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-348aed1f-e5bc-4137-99b7-79cfddaf3061 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.172701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.172778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.173635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.173635] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('348aed1f-e5bc-4137-99b7-79cfddaf3061',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.250258] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 745.250258] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 deletion is rescheduled due to dependency. [ 745.250258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.250437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.250714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.250939] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.254148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.254148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.254148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.254148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.254148] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.519077] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76494ce4-3ed0-426c-ac36-271f9eef282c in Status: SUCCESS [ 745.519077] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76494ce4-3ed0-426c-ac36-271f9eef282c deletion is rescheduled due to dependency. [ 745.519077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76494ce4-3ed0-426c-ac36-271f9eef282c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.672814] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.672814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.677165] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 348aed1f-e5bc-4137-99b7-79cfddaf3061 with status ACTIVE [ 745.677491] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.677738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.677884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.678202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.678437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.678716] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.678977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.679145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.679384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.679541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.679817] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.680214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.680395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.680660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.680856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.681080] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 348aed1f-e5bc-4137-99b7-79cfddaf3061 is going to be updated. [ 745.705899] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.705899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.705899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.706171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.709039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.709039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-348aed1f-e5bc-4137-99b7-79cfddaf3061" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.719996] env[65162]: INFO networking_nsxv3.common.synchronization [None req-e2077d2a-b409-401f-a0aa-ca3a3371965b None None] Enqueued Resource ID: 2033d58f-70f1-4678-bb6b-328d8357e6c6 with Priority: HIGHEST for action port [ 745.720622] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2033d58f-70f1-4678-bb6b-328d8357e6c6 with Priority: HIGHEST for action port [ 745.720981] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2033d58f-70f1-4678-bb6b-328d8357e6c6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.721140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2033d58f-70f1-4678-bb6b-328d8357e6c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.721398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2033d58f-70f1-4678-bb6b-328d8357e6c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.721663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2033d58f-70f1-4678-bb6b-328d8357e6c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.721774] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2033d58f-70f1-4678-bb6b-328d8357e6c6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.755785] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.042541] env[65162]: INFO networking_nsxv3.common.synchronization [req-3ea2b146-8f95-41d7-b355-7ef1d32f4c42 req-19fe3a5a-3093-4099-84a4-210198072f75 tempest-ServersTestFqdnHostnames-248459309 tempest-ServersTestFqdnHostnames-248459309-project-member] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_members [ 746.043193] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_members [ 746.043625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.043793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.043873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.044252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.044473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.044635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.044714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.044882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.044989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.045128] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.155588] env[65162]: INFO networking_nsxv3.common.synchronization [None req-685012c2-3e59-485b-9e80-551d404a9d17 tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_rules [ 746.155588] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_rules [ 746.155588] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.155588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.155588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.156223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.156223] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.223789] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2033d58f-70f1-4678-bb6b-328d8357e6c6 [ 746.224189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.224342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.224342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.224585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.224699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.224796] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2033d58f-70f1-4678-bb6b-328d8357e6c6 already deleted. [ 746.224910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2033d58f-70f1-4678-bb6b-328d8357e6c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.258503] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.385538] env[65162]: INFO networking_nsxv3.common.synchronization [None req-613b05a5-c0a8-4a3a-ad7c-d5c3400eaf6a tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_rules [ 746.386045] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_rules [ 746.388657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.388657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.549046] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.549046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.549046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.549046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.549046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.549533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.549533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.549533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.549629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.549629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.549706] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d8d01f-0537-475c-a915-12d156922e75 already deleted. [ 746.549891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.614467] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.614467] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-860" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.614467] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-860" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.614467] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-860" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.615232] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.615560] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.615777] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.616139] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.617699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.617699] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.617699] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.617699] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.617699] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.617699] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.617699] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.617699] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.646594] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.646763] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.646914] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.648098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-860" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.648098] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-b7a63b3f-8f19-43bf-a140-0fde457e59f6 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.648098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.648098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.648098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.648547] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a63b3f-8f19-43bf-a140-0fde457e59f6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.685841] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.686112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.686112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.686285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.686375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.686478] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 already deleted. [ 746.686568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.687197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.687325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.687413] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.764390] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.764651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.764957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.765165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.765342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.765512] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be updated. [ 746.802370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.802707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.802834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.803104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.803714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.813553] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 747.043429] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 747.043729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.045565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.045565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.045565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.045565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.045565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.045565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.045565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.045565] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.150998] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.151330] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.151498] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.151779] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.151956] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.152150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port b7a63b3f-8f19-43bf-a140-0fde457e59f6 not found, creating... [ 747.152491] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.152590] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.152705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.152944] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.153095] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.153406] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.153572] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.153685] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.153922] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.154749] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.154960] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: b7a63b3f-8f19-43bf-a140-0fde457e59f6 is going to be created. [ 747.184569] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.184774] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.184960] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.185303] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.185588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.185850] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.210720] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.210720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.210943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.211040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.211149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.211262] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 already deleted. [ 747.211460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.547830] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.843850] env[65162]: INFO networking_nsxv3.common.synchronization [req-e83f217a-2676-4aaa-b399-52c2f9c58991 req-c0daeea0-2b0d-4de5-ab40-3e4f57c6dba8 tempest-VolumesAssistedSnapshotsTest-1337621346 tempest-VolumesAssistedSnapshotsTest-1337621346-project-member] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_members [ 747.844517] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGHEST for action security_group_members [ 747.844886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.845094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.845203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.845418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.845584] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.845694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.845750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.845978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.845978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.846141] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.964676] env[65162]: INFO networking_nsxv3.common.synchronization [req-3ea2b146-8f95-41d7-b355-7ef1d32f4c42 req-0976cd96-f3f4-4076-bbe4-8538ab1df4c3 service nova] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_rules [ 747.965071] env[65162]: INFO networking_nsxv3.common.synchronization [req-3ea2b146-8f95-41d7-b355-7ef1d32f4c42 req-0976cd96-f3f4-4076-bbe4-8538ab1df4c3 service nova] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_members [ 747.968263] env[65162]: INFO networking_nsxv3.common.synchronization [req-3ea2b146-8f95-41d7-b355-7ef1d32f4c42 req-0976cd96-f3f4-4076-bbe4-8538ab1df4c3 service nova] Enqueued Resource ID: b7a63b3f-8f19-43bf-a140-0fde457e59f6 with Priority: HIGHEST for action port [ 747.969503] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_rules [ 747.969503] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_members [ 747.969503] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7a63b3f-8f19-43bf-a140-0fde457e59f6 with Priority: HIGHEST for action port [ 747.970596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.970596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.970596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.970596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.970596] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.971573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.971732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.971830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.972093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.972481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.972481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.972603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.972716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.972849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.972955] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.975357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7a63b3f-8f19-43bf-a140-0fde457e59f6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.975357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.975357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.975357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.975357] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a63b3f-8f19-43bf-a140-0fde457e59f6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.050612] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.196212] env[65162]: INFO networking_nsxv3.common.synchronization [None req-7b34820b-84f5-4ea8-a740-9001633737ae None None] Enqueued Resource ID: 839531a5-89a2-45df-ba1d-544d4140de56 with Priority: HIGHEST for action port [ 748.196212] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839531a5-89a2-45df-ba1d-544d4140de56 with Priority: HIGHEST for action port [ 748.196212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-839531a5-89a2-45df-ba1d-544d4140de56 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.196212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-839531a5-89a2-45df-ba1d-544d4140de56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.196212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-839531a5-89a2-45df-ba1d-544d4140de56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.196720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-839531a5-89a2-45df-ba1d-544d4140de56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.196903] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('839531a5-89a2-45df-ba1d-544d4140de56',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.349882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.349882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.349882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.349882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.349882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.349882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.350237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.352544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.352544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.352544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.352544] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 is going to be updated. [ 748.404855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.404855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.404855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.407635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.407635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.419358] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a33b05-c764-41fc-b486-255a775ecff1 in Status: IN_PROGRESS for 2s [ 748.479211] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.480475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.480601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.489267] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7a63b3f-8f19-43bf-a140-0fde457e59f6 with status ACTIVE [ 748.489267] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.489267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.489267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.489267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.489267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489698] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.489698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.489698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.489855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.489855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.490118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.490252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.490307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.493046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.493046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.493046] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7a63b3f-8f19-43bf-a140-0fde457e59f6 is going to be updated. [ 748.525500] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.525703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.525703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.525823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.526013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.526131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7a63b3f-8f19-43bf-a140-0fde457e59f6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.556734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.557145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.557145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.557145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.557282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.557373] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be updated. [ 748.609424] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.609424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.609424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.609424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.609424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.620728] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 748.700096] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 839531a5-89a2-45df-ba1d-544d4140de56 [ 748.700527] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.700743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.700880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.701243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.701423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.701596] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:839531a5-89a2-45df-ba1d-544d4140de56 already deleted. [ 748.701714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-839531a5-89a2-45df-ba1d-544d4140de56" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.826400] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 748.826400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.826614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.827394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.827394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.827394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.827394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.827681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.827942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828372] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.981937] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.332739] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.332941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.332983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.333226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.333464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.333615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.333660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.333798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.333885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.334032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.334265] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.334348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.334348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.334525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.334666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.334756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.334814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.334973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.335137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.335137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.335276] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.492540] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.492734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.492806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.493069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.493197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.493294] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d8d01f-0537-475c-a915-12d156922e75 is going to be created. [ 749.526354] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.526555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.526630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.526831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.526993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.539335] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d8d01f-0537-475c-a915-12d156922e75 in Status: UNINITIALIZED for 2s [ 749.837518] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dd59e3c-797c-4664-8f76-fa18f1a811b1: rpc.has_security_group_logging(os_id): False [ 749.858270] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.858457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.858524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.859028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.859154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.859430] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.859824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.859824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.859824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.859824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.860031] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.860108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.860156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.860282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.860356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.860532] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.860621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.860673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.860843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.860917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.861009] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be updated. [ 750.001187] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.001187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.001187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.001187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.001187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.048731] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 750.431039] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a33b05-c764-41fc-b486-255a775ecff1 in Status: SUCCESS [ 750.431292] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 deletion is rescheduled due to dependency. [ 750.431823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.632698] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 750.632698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.632984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.633292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.633292] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.633488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.633488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.633744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.633744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.633744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.633899] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.139012] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.139426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.139426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.139426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.139818] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.139958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.139958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.140359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.140359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.140359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.140552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.140612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.140673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.140816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.140955] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.142435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.142435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.142435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.142435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.142435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.142435] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.554240] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d8d01f-0537-475c-a915-12d156922e75 in Status: SUCCESS [ 751.554413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.554608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.554899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.555177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.555315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.555383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.555547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.555629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.555721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.555836] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.646185] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afc090b2-bc85-4f97-aa84-42fe4b3085b7: rpc.has_security_group_logging(os_id): False [ 751.667948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.668161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.668161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.668384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.668475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.668657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.668785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.668839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.669724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.669724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.669724] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.669724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.669724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.669724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.669724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.670055] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.670055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.670138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.670251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.670327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.670411] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be updated. [ 751.751049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.751263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.751375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.751703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.751974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.800116] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 752.062131] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.065571] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 752.065798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.091026] env[65162]: INFO networking_nsxv3.common.synchronization [req-5acb1343-968c-4461-8c91-a66406a2a9c7 req-b4194cc1-277c-464d-9075-625536e84598 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 752.091603] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 752.092015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.093657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.093657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.093657] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.564508] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42d8d01f-0537-475c-a915-12d156922e75: rpc.has_security_group_logging(os_id): False [ 752.585808] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.585965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.586047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.586299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.586397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.586638] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.586741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.586790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.586940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.587030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.587111] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d8d01f-0537-475c-a915-12d156922e75 is going to be created. [ 752.595146] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.595772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.595772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.595772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.596382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.596739] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.596964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.597086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.597371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.597485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.598037] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 752.633047] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.633047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.633047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.633047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.633047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.646916] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 752.661943] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.662150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.662222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.662444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.662615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.675302] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d8d01f-0537-475c-a915-12d156922e75 in Status: IN_PROGRESS for 2s [ 753.816320] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 753.816647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.297954] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bcb256c-c8a3-465f-864a-877838558742 req-e3356639-6f3b-43b9-abcf-059b447e5e5e tempest-ServerMetadataNegativeTestJSON-1275583816 tempest-ServerMetadataNegativeTestJSON-1275583816-project-member] Enqueued Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_members [ 754.297954] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_members [ 754.297954] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.297954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.297954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.298366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.298398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.298987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.299088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.299230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.299394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.299441] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.662880] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 754.662880] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 754.662880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.700585] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d8d01f-0537-475c-a915-12d156922e75 in Status: SUCCESS [ 754.704664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.786319] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.786528] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-254" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.786644] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-254" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.786963] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-254" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.787246] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.787390] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.787496] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.789239] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.789422] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.789690] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.789809] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.789897] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.789994] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.790554] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.790554] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.790554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.801672] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.801824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.801896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.802184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.802285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.803057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.803057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.803057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.803057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.803057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.803057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31518b2-675c-4e16-bc68-e78685912b4e already deleted. [ 754.803057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.816241] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.816241] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.816241] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.816241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-254" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.816241] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-24ad8078-430a-44df-8c6b-b824f831d924 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.816241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.816241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.816241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.816241] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24ad8078-430a-44df-8c6b-b824f831d924',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.319527] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.319976] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.320299] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.320518] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.320696] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.320855] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 24ad8078-430a-44df-8c6b-b824f831d924 not found, creating... [ 755.321142] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.321297] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.321407] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.321634] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.321785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.322157] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.322317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.322559] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.322731] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.322924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.323085] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 24ad8078-430a-44df-8c6b-b824f831d924 is going to be created. [ 755.349759] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.350350] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.350959] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.352307] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.353045] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.354064] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.613309] env[65162]: INFO networking_nsxv3.common.synchronization [None req-015237e4-592a-4a11-a706-8db5ab69d333 None None] Enqueued Resource ID: 14eae2fe-59b9-4674-857f-2b7e2f1c0955 with Priority: HIGHEST for action port [ 755.614065] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14eae2fe-59b9-4674-857f-2b7e2f1c0955 with Priority: HIGHEST for action port [ 755.614509] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-14eae2fe-59b9-4674-857f-2b7e2f1c0955 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.614643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14eae2fe-59b9-4674-857f-2b7e2f1c0955" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.614737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14eae2fe-59b9-4674-857f-2b7e2f1c0955" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.615009] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14eae2fe-59b9-4674-857f-2b7e2f1c0955" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.616459] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14eae2fe-59b9-4674-857f-2b7e2f1c0955',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.121200] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14eae2fe-59b9-4674-857f-2b7e2f1c0955 [ 756.121449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.121582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.121629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.121843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.121924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.122070] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14eae2fe-59b9-4674-857f-2b7e2f1c0955 already deleted. [ 756.122400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14eae2fe-59b9-4674-857f-2b7e2f1c0955" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.238026] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bcb256c-c8a3-465f-864a-877838558742 req-4b581781-ddb7-4531-a22b-417f7da09c4f service nova] Enqueued Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_rules [ 756.238026] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bcb256c-c8a3-465f-864a-877838558742 req-4b581781-ddb7-4531-a22b-417f7da09c4f service nova] Enqueued Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_members [ 756.238026] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bcb256c-c8a3-465f-864a-877838558742 req-4b581781-ddb7-4531-a22b-417f7da09c4f service nova] Enqueued Resource ID: 24ad8078-430a-44df-8c6b-b824f831d924 with Priority: HIGHEST for action port [ 756.238026] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_rules [ 756.238026] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_members [ 756.238026] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ad8078-430a-44df-8c6b-b824f831d924 with Priority: HIGHEST for action port [ 756.238026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.238026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.238026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.238825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.239646] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.243076] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.243076] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.243076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.243076] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.244745] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-24ad8078-430a-44df-8c6b-b824f831d924 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.245544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.247857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.247857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.247857] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24ad8078-430a-44df-8c6b-b824f831d924',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.750023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.750114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.750708] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.752977] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24ad8078-430a-44df-8c6b-b824f831d924 with status ACTIVE [ 756.752977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.752977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.752977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.752977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.753373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.753429] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.753687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.753687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.757534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.757534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.758448] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.758448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.758448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.758448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.758448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.758448] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24ad8078-430a-44df-8c6b-b824f831d924 is going to be updated. [ 756.790482] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.793362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.793362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.793362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.793362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.793362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24ad8078-430a-44df-8c6b-b824f831d924" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.264511] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.765570] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.765570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.765570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.765889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.765889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.765994] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31518b2-675c-4e16-bc68-e78685912b4e is going to be created. [ 757.796015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.796200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.796244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.796592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.796755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.808362] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31518b2-675c-4e16-bc68-e78685912b4e in Status: UNINITIALIZED for 2s [ 757.852375] env[65162]: INFO networking_nsxv3.common.synchronization [None req-3509e5e4-586a-4284-a530-521cc846aaac tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 757.854507] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 757.854507] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.854507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.859020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.859020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.859020] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.035430] env[65162]: INFO networking_nsxv3.common.synchronization [None req-bd6227d5-0e08-4b42-ab92-afc5d812af02 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 758.036225] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 758.037123] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.037269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.382355] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.382793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.382793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.382793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.383167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.383167] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e already deleted. [ 758.383167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.383409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.383409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.383518] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.606410] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c2a4d8c7-e8a1-45bd-a7aa-ed2e605a1c72 None None] Enqueued Resource ID: 12483580-a81e-49a5-836a-cc356d8ef6f7 with Priority: HIGHEST for action port [ 758.606928] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12483580-a81e-49a5-836a-cc356d8ef6f7 with Priority: HIGHEST for action port [ 758.607602] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-12483580-a81e-49a5-836a-cc356d8ef6f7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.607763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12483580-a81e-49a5-836a-cc356d8ef6f7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.607763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12483580-a81e-49a5-836a-cc356d8ef6f7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.608113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12483580-a81e-49a5-836a-cc356d8ef6f7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.608207] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12483580-a81e-49a5-836a-cc356d8ef6f7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.909822] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.911117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.911117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.911117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.911117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.911117] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e already deleted. [ 758.911117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.112333] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12483580-a81e-49a5-836a-cc356d8ef6f7 [ 759.112591] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.112754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.112830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.113129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.113273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.113414] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12483580-a81e-49a5-836a-cc356d8ef6f7 already deleted. [ 759.113483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12483580-a81e-49a5-836a-cc356d8ef6f7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.828900] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31518b2-675c-4e16-bc68-e78685912b4e in Status: SUCCESS [ 759.829205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.829983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.830275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.830565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.830663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.830702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.830914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.831188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.831188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.831315] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.121232] env[65162]: INFO networking_nsxv3.common.synchronization [None req-7938bfad-e082-4c84-8a43-3d15eda124d7 None None] Enqueued Resource ID: fd724110-cd2f-47b4-a688-c1b22604ac18 with Priority: HIGHEST for action port [ 760.122111] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd724110-cd2f-47b4-a688-c1b22604ac18 with Priority: HIGHEST for action port [ 760.123306] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd724110-cd2f-47b4-a688-c1b22604ac18 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.123306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd724110-cd2f-47b4-a688-c1b22604ac18" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.123306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd724110-cd2f-47b4-a688-c1b22604ac18" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.123306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd724110-cd2f-47b4-a688-c1b22604ac18" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.123306] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd724110-cd2f-47b4-a688-c1b22604ac18',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.188122] env[65162]: INFO networking_nsxv3.common.synchronization [req-b953fc00-6c8a-4dc4-8ae1-f13cb298b94b req-cc6c2f35-5256-4db1-b4bf-68876f8c2a15 tempest-ServersTestManualDisk-2035761477 tempest-ServersTestManualDisk-2035761477-project-member] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_members [ 760.192090] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGHEST for action security_group_members [ 760.192867] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.193032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.193114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.193411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.193580] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.193790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.193888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.194244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.194411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.194525] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.333393] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.334567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.334567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.334567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.334567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.334915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.334915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.334915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.335180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.335180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.335573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.335573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.335784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.335926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.336092] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.336198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.336255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.339893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.339893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.339893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.339893] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.627860] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd724110-cd2f-47b4-a688-c1b22604ac18 [ 760.628249] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.628432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.628506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.628793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.628942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.629760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd724110-cd2f-47b4-a688-c1b22604ac18 already deleted. [ 760.629760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd724110-cd2f-47b4-a688-c1b22604ac18" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.697397] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.700054] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.700054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.700054] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 is going to be updated. [ 760.737736] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.737950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.738163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.738731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.738731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.750347] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 in Status: IN_PROGRESS for 2s [ 760.840847] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a31518b2-675c-4e16-bc68-e78685912b4e: rpc.has_security_group_logging(os_id): False [ 760.864177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.864177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.864177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.865197] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.866167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.866167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.866872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.869682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.869682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.869682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.869682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.869682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.869682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.869682] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31518b2-675c-4e16-bc68-e78685912b4e is going to be created. [ 760.950261] env[65162]: INFO networking_nsxv3.common.synchronization [req-c228661f-e54e-47cf-b8e7-e7e4d28296e0 req-81b7141c-5ece-4d7f-a013-e8f95293e892 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_members [ 760.951511] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_members [ 760.952437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.952852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.953090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.953632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.954135] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.954453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.955268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.955674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.955987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.956325] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.001661] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.001661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.001661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.001661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.001661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.022096] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31518b2-675c-4e16-bc68-e78685912b4e in Status: IN_PROGRESS for 2s [ 761.460724] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.461094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.461229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.461559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.461657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.461905] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.462221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.462221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.462454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.462550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.462704] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 already deleted. [ 761.462790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.559205] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.559418] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.559553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.559971] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.560975] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.561238] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.561361] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.561808] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.561881] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.562109] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.562218] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.562319] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.562419] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.562610] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.562772] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.563215] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.600196] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.600511] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.600511] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.600674] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.600995] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.601180] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.601302] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.601649] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.601787] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ae5a27-bcd0-4b47-8d28-72bc5f70ed70',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.107053] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.107053] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.107525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.107525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.107683] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.107736] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 not found, creating... [ 762.107988] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.108226] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.108299] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.108471] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.108601] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.108868] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.109066] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.109315] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.109514] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.110561] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.110736] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 is going to be created. [ 762.137758] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.137758] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.137758] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.138016] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.138111] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.138397] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.762839] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 in Status: SUCCESS [ 762.762839] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 deletion is rescheduled due to dependency. [ 762.762839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.915634] env[65162]: INFO networking_nsxv3.common.synchronization [req-c228661f-e54e-47cf-b8e7-e7e4d28296e0 req-66fae9d4-7630-4374-be58-ff4d58dea7f7 service nova] Enqueued Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_rules [ 762.915852] env[65162]: INFO networking_nsxv3.common.synchronization [req-c228661f-e54e-47cf-b8e7-e7e4d28296e0 req-66fae9d4-7630-4374-be58-ff4d58dea7f7 service nova] Enqueued Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_members [ 762.916041] env[65162]: INFO networking_nsxv3.common.synchronization [req-c228661f-e54e-47cf-b8e7-e7e4d28296e0 req-66fae9d4-7630-4374-be58-ff4d58dea7f7 service nova] Enqueued Resource ID: 86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 with Priority: HIGHEST for action port [ 762.916747] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_rules [ 762.916924] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_members [ 762.917096] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 with Priority: HIGHEST for action port [ 762.917481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.917649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.917742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.917988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.918120] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.920374] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.920374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.920374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.920580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.920681] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.920828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.920910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.921095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.923528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.923528] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.923528] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.923528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.923528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.923528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.923528] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ae5a27-bcd0-4b47-8d28-72bc5f70ed70',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.964209] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b586544b-f6b7-42bc-8985-2766e164b567 None None] Enqueued Resource ID: d7790e83-4632-4859-9335-ac105ab18cf0 with Priority: HIGHEST for action port [ 762.964755] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7790e83-4632-4859-9335-ac105ab18cf0 with Priority: HIGHEST for action port [ 762.965051] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7790e83-4632-4859-9335-ac105ab18cf0 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.965246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7790e83-4632-4859-9335-ac105ab18cf0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.965323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7790e83-4632-4859-9335-ac105ab18cf0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.965590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7790e83-4632-4859-9335-ac105ab18cf0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.965680] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7790e83-4632-4859-9335-ac105ab18cf0',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.038125] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31518b2-675c-4e16-bc68-e78685912b4e in Status: SUCCESS [ 763.038364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.424875] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.425385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.425385] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.426258] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 with status ACTIVE [ 763.426474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.426601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.426671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.426880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.427053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.427161] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.427302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.427340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.427461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.427536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.427707] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.427796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.427856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.427992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.428808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.428990] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ae5a27-bcd0-4b47-8d28-72bc5f70ed70 is going to be updated. [ 763.455196] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.455426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.455426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.455733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.455974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.456054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ae5a27-bcd0-4b47-8d28-72bc5f70ed70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.468057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7790e83-4632-4859-9335-ac105ab18cf0 [ 763.468375] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.468510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.468576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.468812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.468945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.469096] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7790e83-4632-4859-9335-ac105ab18cf0 already deleted. [ 763.469195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7790e83-4632-4859-9335-ac105ab18cf0" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.931407] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.435049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.435049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.435049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.435049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.435645] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.435645] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 is going to be created. [ 764.463145] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.463334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.463395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.463569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.463804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.476016] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 in Status: UNINITIALIZED for 2s [ 766.492564] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 in Status: SUCCESS [ 766.492896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.493894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.493894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.493894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.493894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.493894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.494878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.494878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.494878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.494878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.997563] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.349258] env[65162]: INFO networking_nsxv3.common.synchronization [req-04b8b1ae-58ca-4127-a766-fde856f911f2 req-6b477543-70bc-40a0-afc7-14238e7a6dc6 tempest-InstanceActionsNegativeTestJSON-2012875378 tempest-InstanceActionsNegativeTestJSON-2012875378-project-member] Enqueued Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_members [ 767.350696] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_members [ 767.351588] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.353834] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.353834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.353834] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.499966] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f904e96-f18d-4ef1-be07-0c2f77a78a73: rpc.has_security_group_logging(os_id): False [ 767.520886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.521215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.521215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.521351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.521442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.521678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.521783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.521849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.522019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.522100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.522318] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 is going to be created. [ 767.596281] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.597103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.597103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.597685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.598121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.612881] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 in Status: IN_PROGRESS for 2s [ 767.856178] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.856374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.856416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.856662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.856759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.856961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.857089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.857145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.857318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.857877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.857877] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 already deleted. [ 767.857877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.891574] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-263 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.892207] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-263" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.892207] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-263" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.892285] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-263" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.892485] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.892634] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.892741] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.892946] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.893274] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.893482] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.894435] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.894565] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.894675] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.894829] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.894977] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.895068] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.916137] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.916342] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.916462] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.916608] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-263" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.916907] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.917088] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.917203] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.917526] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.917657] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1123e0a-44d8-44d7-9398-f73b6bdbed3a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.422183] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.422398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.422398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.423063] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.423063] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.423137] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port d1123e0a-44d8-44d7-9398-f73b6bdbed3a not found, creating... [ 768.423509] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.423705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.423841] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.424200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.425046] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.425497] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.426101] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.426908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.426908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.426908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.427122] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: d1123e0a-44d8-44d7-9398-f73b6bdbed3a is going to be created. [ 768.453537] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.453537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.453804] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.453934] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.454374] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.454673] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.167803] env[65162]: INFO networking_nsxv3.common.synchronization [req-04b8b1ae-58ca-4127-a766-fde856f911f2 req-e548151a-e6e8-46e6-9e74-f5adb1269b76 service nova] Enqueued Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_rules [ 769.167803] env[65162]: INFO networking_nsxv3.common.synchronization [req-04b8b1ae-58ca-4127-a766-fde856f911f2 req-e548151a-e6e8-46e6-9e74-f5adb1269b76 service nova] Enqueued Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_members [ 769.167803] env[65162]: INFO networking_nsxv3.common.synchronization [req-04b8b1ae-58ca-4127-a766-fde856f911f2 req-e548151a-e6e8-46e6-9e74-f5adb1269b76 service nova] Enqueued Resource ID: d1123e0a-44d8-44d7-9398-f73b6bdbed3a with Priority: HIGHEST for action port [ 769.167803] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_rules [ 769.167803] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_members [ 769.167803] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1123e0a-44d8-44d7-9398-f73b6bdbed3a with Priority: HIGHEST for action port [ 769.168247] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.168247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.168247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.169073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.169073] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.169497] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.169630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.169914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.170150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.171983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.172148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.172221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.172414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.172463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.172553] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.173658] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.173771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.173839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.174382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.174382] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1123e0a-44d8-44d7-9398-f73b6bdbed3a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.626421] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 in Status: SUCCESS [ 769.626656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.676821] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.676821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.677142] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.677854] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1123e0a-44d8-44d7-9398-f73b6bdbed3a with status ACTIVE [ 769.679329] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.679329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.679329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.679520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.679608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.679802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.679916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.679979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.680146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.680226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.680453] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.680602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.680602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.680692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.680761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.680845] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1123e0a-44d8-44d7-9398-f73b6bdbed3a is going to be updated. [ 769.706252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.706513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.706513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.706703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.706855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.707104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1123e0a-44d8-44d7-9398-f73b6bdbed3a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.778368] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd88197c-b2fd-46c6-954f-daebfce671f2 req-40e64c1e-786b-4140-8612-c6a93e80b3b2 tempest-ServersWithSpecificFlavorTestJSON-515804645 tempest-ServersWithSpecificFlavorTestJSON-515804645-project-member] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 769.779091] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 769.779400] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.779513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.779576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.779763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.780386] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.780386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.780386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.780386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.780386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.780386] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.180295] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.180624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.180624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.182228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.182228] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.182228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.182228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.182586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.182586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.182681] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.182816] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.182883] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.182998] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.183072] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.183169] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.183294] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.184787] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.210382] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.210738] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.210899] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.211052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-846" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.211579] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-97e0cb89-5786-47c4-89ab-daabc87449da taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.211801] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.211920] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.212630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.212630] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97e0cb89-5786-47c4-89ab-daabc87449da',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.283248] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.283419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.283490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.283712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.283808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.284022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.284199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.284273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.284450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.284548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.284645] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be updated. [ 770.316391] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.316391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.316391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.316391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.316728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.327804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 770.689691] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.689896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.689977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.690230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.690320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.690446] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 is going to be created. [ 770.715605] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.715871] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.715993] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.716373] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.716683] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.716920] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 97e0cb89-5786-47c4-89ab-daabc87449da not found, creating... [ 770.717264] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.717548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.717624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.717886] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.718049] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.718423] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.718616] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.718780] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.719017] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.720203] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.720203] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 97e0cb89-5786-47c4-89ab-daabc87449da is going to be created. [ 770.721742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.721885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.722064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.722157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.722377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.735368] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 in Status: UNINITIALIZED for 2s [ 770.748548] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.748548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.748548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.748548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.748924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.748924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.521052] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd88197c-b2fd-46c6-954f-daebfce671f2 req-c92193a9-42bc-4b13-8cda-6ff35a07dbaf service nova] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 771.521776] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd88197c-b2fd-46c6-954f-daebfce671f2 req-c92193a9-42bc-4b13-8cda-6ff35a07dbaf service nova] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 771.521889] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd88197c-b2fd-46c6-954f-daebfce671f2 req-c92193a9-42bc-4b13-8cda-6ff35a07dbaf service nova] Enqueued Resource ID: 97e0cb89-5786-47c4-89ab-daabc87449da with Priority: HIGHEST for action port [ 771.522896] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_rules [ 771.523305] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 771.523305] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e0cb89-5786-47c4-89ab-daabc87449da with Priority: HIGHEST for action port [ 771.523683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.523891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.523891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.524747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.524747] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.525934] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.526634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.526634] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-97e0cb89-5786-47c4-89ab-daabc87449da taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.526634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.526634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.527210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.527338] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97e0cb89-5786-47c4-89ab-daabc87449da',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.595513] env[65162]: INFO networking_nsxv3.common.synchronization [req-3e65bd9a-ed2c-4e88-946c-cf7eb9c006d3 req-1097cbfc-4480-45ab-ac1f-16930efe25f6 tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 771.599399] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 771.601741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.601741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.601741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.601741] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.029300] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.029473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.029702] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97e0cb89-5786-47c4-89ab-daabc87449da with status ACTIVE [ 772.032091] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.032091] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.032091] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.032091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.032892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.032993] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97e0cb89-5786-47c4-89ab-daabc87449da is going to be updated. [ 772.055248] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.055248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.055248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.055435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.055661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.055730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97e0cb89-5786-47c4-89ab-daabc87449da" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.110618] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.110618] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.110618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.111318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.111318] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be updated. [ 772.147806] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.147806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.147806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.147991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.147991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.159263] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 772.342836] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 772.343020] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db deletion is rescheduled due to dependency. [ 772.343147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.343323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.343537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.343723] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.343843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.343926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.344072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.344160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.344282] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.751430] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 in Status: SUCCESS [ 772.751776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.752019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.752567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.752567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.752727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.752727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.752893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.752991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.753572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.753572] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.850697] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.256714] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.256877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.256949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.257197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.257364] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.257466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.257535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.257682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.257767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.257856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.257999] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.258105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.258165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.258306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.258442] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.258531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.258591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.258720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.258794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.258882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.259027] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.355664] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.761903] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521e5e7b-7b42-4883-9df9-2190fd9e6337: rpc.has_security_group_logging(os_id): False [ 773.783885] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.784086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.784086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.784367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.784531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.784786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.784932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.785046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.785231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.785309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.785532] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.785657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.785657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.785840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.785892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.786112] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.786254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.786354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.786532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.786606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.786735] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 is going to be created. [ 773.849821] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.850039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.850039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.850275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.850810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.858595] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.858878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.858878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.859156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.859311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.859408] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be updated. [ 773.865095] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 in Status: IN_PROGRESS for 2s [ 773.913297] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.913523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.913587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.913800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.913979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.925092] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 774.169417] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 774.169598] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 deletion is rescheduled due to dependency. [ 774.169721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.912875] env[65162]: INFO networking_nsxv3.common.synchronization [req-e7f05187-5bce-494b-8fa1-7e63b0446164 req-624b5d2c-3553-43ab-b4e8-228e345bcddf tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 774.918232] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 774.918232] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.918232] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.918232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.918232] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.422277] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.422520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.422598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.422837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.422942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.423168] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.423283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.423371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.423567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.423679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.423789] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 775.455771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.455771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.455771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.455771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.456199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.467184] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 775.882225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 in Status: SUCCESS [ 775.882409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.935103] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 775.935374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.935544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.935742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.935944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.936085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.936151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.936403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.936403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.936477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.936579] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.441013] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.725713] env[65162]: INFO networking_nsxv3.common.synchronization [req-65caeba8-f9c1-461f-87bb-a1c5123ecb8c req-6fefc67d-76a7-4fcc-8b54-53aeb54eee42 tempest-ServersNegativeTestJSON-1754726929 tempest-ServersNegativeTestJSON-1754726929-project-member] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 776.727872] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 776.727872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.727872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.727872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.727872] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.943791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6661d9a-0a2f-4ad7-a804-9e5004aa95db: rpc.has_security_group_logging(os_id): False [ 776.966618] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.966618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.966618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.967454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.967454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.967454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.967454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.967454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.967618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.967618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.967672] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be updated. [ 777.059642] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.059811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.059851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.060091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.060237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.077032] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 777.231202] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.305300] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.308530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.308530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.308530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.309091] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.309155] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.309259] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.309510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.310951] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.311088] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.312038] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.312038] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.312038] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.312038] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.312289] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.312289] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.341674] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.341929] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.342355] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.342977] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.343090] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-f533d0c0-3521-490c-aca7-c809eb63638b taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.343319] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.343491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.344194] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.344194] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f533d0c0-3521-490c-aca7-c809eb63638b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.481197] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 777.481389] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 777.481514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.733966] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.848433] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.848784] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.849018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.849415] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.849640] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.849920] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port f533d0c0-3521-490c-aca7-c809eb63638b not found, creating... [ 777.850487] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.850717] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.850879] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.851392] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.852718] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.852718] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.852718] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.852718] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.853051] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.853183] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.853499] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: f533d0c0-3521-490c-aca7-c809eb63638b is going to be created. [ 777.880517] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.881530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.881530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.882096] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.882362] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.882649] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.236626] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.237062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.237062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.237247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.237295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.237378] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 778.289492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.289789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.289789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.289916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.292819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.302979] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 778.998806] env[65162]: INFO networking_nsxv3.common.synchronization [req-65caeba8-f9c1-461f-87bb-a1c5123ecb8c req-0f848cbc-8b93-4548-b982-a3aab65a784d service nova] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_rules [ 778.999029] env[65162]: INFO networking_nsxv3.common.synchronization [req-65caeba8-f9c1-461f-87bb-a1c5123ecb8c req-0f848cbc-8b93-4548-b982-a3aab65a784d service nova] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 778.999226] env[65162]: INFO networking_nsxv3.common.synchronization [req-65caeba8-f9c1-461f-87bb-a1c5123ecb8c req-0f848cbc-8b93-4548-b982-a3aab65a784d service nova] Enqueued Resource ID: f533d0c0-3521-490c-aca7-c809eb63638b with Priority: HIGHEST for action port [ 778.999854] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_rules [ 779.000348] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 779.000829] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f533d0c0-3521-490c-aca7-c809eb63638b with Priority: HIGHEST for action port [ 779.001101] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.001229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.001300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.001600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.001783] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.003635] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.003635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.005137] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f533d0c0-3521-490c-aca7-c809eb63638b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.005137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.005137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.005137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.005137] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f533d0c0-3521-490c-aca7-c809eb63638b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.094487] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 779.094821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.343956] env[65162]: INFO networking_nsxv3.common.synchronization [None req-eb41eaad-8a42-4559-865c-4be489a055b8 None None] Enqueued Resource ID: de72d1b1-627e-44f2-897b-0d2dd0e0cf71 with Priority: HIGHEST for action port [ 779.343956] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de72d1b1-627e-44f2-897b-0d2dd0e0cf71 with Priority: HIGHEST for action port [ 779.344583] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-de72d1b1-627e-44f2-897b-0d2dd0e0cf71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.344724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de72d1b1-627e-44f2-897b-0d2dd0e0cf71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.348028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de72d1b1-627e-44f2-897b-0d2dd0e0cf71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.348028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de72d1b1-627e-44f2-897b-0d2dd0e0cf71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.348028] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de72d1b1-627e-44f2-897b-0d2dd0e0cf71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.507071] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.507204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.507398] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f533d0c0-3521-490c-aca7-c809eb63638b with status ACTIVE [ 779.507577] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.507686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.507750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.507964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.508071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.508279] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.508367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.508428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.508579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.508756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.508824] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.508927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.508983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.509125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.509194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.509276] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f533d0c0-3521-490c-aca7-c809eb63638b is going to be updated. [ 779.536229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.536395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.536522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.536760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.536921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.537130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f533d0c0-3521-490c-aca7-c809eb63638b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.851424] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de72d1b1-627e-44f2-897b-0d2dd0e0cf71 [ 779.851664] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.851800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.851862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.852113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.852280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.852337] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de72d1b1-627e-44f2-897b-0d2dd0e0cf71 already deleted. [ 779.852425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de72d1b1-627e-44f2-897b-0d2dd0e0cf71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.316416] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 780.316476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.316668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.316884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.317099] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.317216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.317283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.317431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.317512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.317609] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.465847] env[65162]: INFO networking_nsxv3.common.synchronization [None req-475fcbcb-5892-43fb-9495-92ede46e1a03 tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 780.467201] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 780.467678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.467993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.468084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.468430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.468517] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.636194] env[65162]: INFO networking_nsxv3.common.synchronization [None req-9b725b13-5ba0-4645-8e04-1444708704b8 tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 780.636194] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 780.636912] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.638069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.822553] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.991237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.991563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.991663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.991913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.992026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.992163] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 already deleted. [ 780.992307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.992677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.992677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.992787] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.326545] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.518141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.518502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.518502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.518566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.518968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.518968] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 already deleted. [ 781.518968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.828554] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.828754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.828828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.829009] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.829109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.829207] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 781.868339] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.868339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.868339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.868602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.868697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.883899] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 782.277124] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ee39bb5a-9c18-423e-804f-6b93527fc247 None None] Enqueued Resource ID: 371aea2d-811d-4ef1-8703-c887e6c1e6ad with Priority: HIGHEST for action port [ 782.277801] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371aea2d-811d-4ef1-8703-c887e6c1e6ad with Priority: HIGHEST for action port [ 782.278138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-371aea2d-811d-4ef1-8703-c887e6c1e6ad taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.278281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-371aea2d-811d-4ef1-8703-c887e6c1e6ad" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.278365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-371aea2d-811d-4ef1-8703-c887e6c1e6ad" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.278884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-371aea2d-811d-4ef1-8703-c887e6c1e6ad" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.278884] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371aea2d-811d-4ef1-8703-c887e6c1e6ad',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.781382] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 371aea2d-811d-4ef1-8703-c887e6c1e6ad [ 782.782233] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.782233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.782233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.782437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.782575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.782696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:371aea2d-811d-4ef1-8703-c887e6c1e6ad already deleted. [ 782.782801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-371aea2d-811d-4ef1-8703-c887e6c1e6ad" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.206954] env[65162]: INFO networking_nsxv3.common.synchronization [None req-310b22da-d420-4a1d-8319-83aaf0fcc577 None None] Enqueued Resource ID: 84489cde-03f4-4c38-ac73-17e77085a95f with Priority: HIGHEST for action port [ 783.207544] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84489cde-03f4-4c38-ac73-17e77085a95f with Priority: HIGHEST for action port [ 783.207780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-84489cde-03f4-4c38-ac73-17e77085a95f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.207967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84489cde-03f4-4c38-ac73-17e77085a95f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.207967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84489cde-03f4-4c38-ac73-17e77085a95f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.208667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84489cde-03f4-4c38-ac73-17e77085a95f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.208758] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84489cde-03f4-4c38-ac73-17e77085a95f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.348402] env[65162]: INFO networking_nsxv3.common.synchronization [None req-126d04d0-5d3f-43ef-98e3-efb44ded433f None None] Enqueued Resource ID: d415d57f-1742-4321-bcea-a4ad01060e79 with Priority: HIGHEST for action port [ 783.350112] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d415d57f-1742-4321-bcea-a4ad01060e79 with Priority: HIGHEST for action port [ 783.350112] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d415d57f-1742-4321-bcea-a4ad01060e79 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.350112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d415d57f-1742-4321-bcea-a4ad01060e79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.350112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d415d57f-1742-4321-bcea-a4ad01060e79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.350112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d415d57f-1742-4321-bcea-a4ad01060e79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.350112] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d415d57f-1742-4321-bcea-a4ad01060e79',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.712048] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84489cde-03f4-4c38-ac73-17e77085a95f [ 783.712048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.712374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.712374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.712475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.712506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.712675] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84489cde-03f4-4c38-ac73-17e77085a95f already deleted. [ 783.712729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84489cde-03f4-4c38-ac73-17e77085a95f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.852572] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d415d57f-1742-4321-bcea-a4ad01060e79 [ 783.852903] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.853054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.853054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.853270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.854202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.854202] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d415d57f-1742-4321-bcea-a4ad01060e79 already deleted. [ 783.854202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d415d57f-1742-4321-bcea-a4ad01060e79" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.898818] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 783.899113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.899283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.899509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.899717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.899849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.899916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.900097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.900183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.900275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.900384] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.210848] env[65162]: INFO networking_nsxv3.common.synchronization [req-1d67d1cb-745c-40ad-a78a-a9a9243724cb req-617db8c3-8197-4d86-b530-e918469f26e8 tempest-ServerMetadataNegativeTestJSON-1275583816 tempest-ServerMetadataNegativeTestJSON-1275583816-project-member] Enqueued Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_members [ 784.212161] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGHEST for action security_group_members [ 784.212161] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.212161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.212161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.214987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.215421] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.215580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.215654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.215881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.215975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.216092] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.409160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.409160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.409160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.409160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.409160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.410088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.410088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.410088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.411600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.411600] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.431124] env[65162]: INFO networking_nsxv3.common.synchronization [req-07bf0fa6-c5f3-440a-8616-2af7f548a5e0 req-97406901-d844-43fd-8733-44fb210248fc tempest-VolumesAdminNegativeTest-1239067301 tempest-VolumesAdminNegativeTest-1239067301-project-member] Enqueued Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_members [ 784.431124] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_members [ 784.431124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.431124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.431124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.431124] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.723691] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.723691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.723691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.724348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.724348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.724348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.724570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.724570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.724802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.724802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.724906] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31518b2-675c-4e16-bc68-e78685912b4e is going to be updated. [ 784.766766] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.766766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.766766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.766766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.766766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.779538] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31518b2-675c-4e16-bc68-e78685912b4e in Status: IN_PROGRESS for 2s [ 784.909101] env[65162]: INFO networking_nsxv3.common.synchronization [None req-148eb7c8-5268-49d7-9304-26b43b0be7b2 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_rules [ 784.909975] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_rules [ 784.909975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.910246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.912204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.913048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.913048] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.914831] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9998726b-c2cc-495a-9b94-43b9da32545d: rpc.has_security_group_logging(os_id): False [ 784.936400] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.936400] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.936400] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 already deleted. [ 784.936400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.936400] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.937205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.937386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.937628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.938098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.938454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.938712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.938868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.939117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.939306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.939591] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.940014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.940177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.940412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.940581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.940874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.941157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.941393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.941634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.941806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.941989] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 785.028677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.028767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.028918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.029422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.029679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.057843] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 785.078542] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.079548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.079548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.085955] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.087022] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.087022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.087022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.087328] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.087547] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.087884] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.088070] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.088238] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.088424] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.088615] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.088783] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.089020] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.140197] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.140485] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.140693] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.140954] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-545" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.141552] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-f700cdc4-7865-4ed9-a3bd-33949b66a130 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.141845] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.141979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.142845] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.143040] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f700cdc4-7865-4ed9-a3bd-33949b66a130',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.276848] env[65162]: INFO networking_nsxv3.common.synchronization [None req-7ad8f99b-9af4-4de8-b15e-fa4557302623 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_rules [ 785.280385] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_rules [ 785.280385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.280385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.439399] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.439399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.439399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.440314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.440314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.440314] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb already deleted. [ 785.440314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.440314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.440777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.440777] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.646644] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.646828] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.646964] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.647699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.647699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.647699] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port f700cdc4-7865-4ed9-a3bd-33949b66a130 not found, creating... [ 785.647878] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.647943] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.649022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.649022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.649022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.649022] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.649022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.649022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.649298] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.649298] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.650041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: f700cdc4-7865-4ed9-a3bd-33949b66a130 is going to be created. [ 785.672429] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.672663] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.672749] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.673072] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.673367] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.673471] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.896241] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:0 completed [ 785.896360] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:1 started [ 785.965961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.966373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.966373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.966559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.966559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.966768] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb already deleted. [ 785.966815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.396691] env[65162]: INFO networking_nsxv3.common.synchronization [req-07bf0fa6-c5f3-440a-8616-2af7f548a5e0 req-c7f1b6b0-543b-4c6f-b8e0-665c2819c673 service nova] Enqueued Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_rules [ 786.396691] env[65162]: INFO networking_nsxv3.common.synchronization [req-07bf0fa6-c5f3-440a-8616-2af7f548a5e0 req-c7f1b6b0-543b-4c6f-b8e0-665c2819c673 service nova] Enqueued Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_members [ 786.396691] env[65162]: INFO networking_nsxv3.common.synchronization [req-07bf0fa6-c5f3-440a-8616-2af7f548a5e0 req-c7f1b6b0-543b-4c6f-b8e0-665c2819c673 service nova] Enqueued Resource ID: f700cdc4-7865-4ed9-a3bd-33949b66a130 with Priority: HIGHEST for action port [ 786.397791] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_rules [ 786.397791] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_members [ 786.397791] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f700cdc4-7865-4ed9-a3bd-33949b66a130 with Priority: HIGHEST for action port [ 786.397791] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.398195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.398195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.398195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.398277] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.400581] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.400581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.400581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.400581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.401047] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.401383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.402168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.402461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.403587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.403587] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.405337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f700cdc4-7865-4ed9-a3bd-33949b66a130 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.405431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.406145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.406145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.406145] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f700cdc4-7865-4ed9-a3bd-33949b66a130',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.424358] env[65162]: INFO networking_nsxv3.common.synchronization [None req-1a4d1850-6619-4a2a-9619-57ad4b55f434 None None] Enqueued Resource ID: 38044fcb-ef00-4378-8f0e-caa7a37513b3 with Priority: HIGHEST for action port [ 786.424358] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38044fcb-ef00-4378-8f0e-caa7a37513b3 with Priority: HIGHEST for action port [ 786.424767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-38044fcb-ef00-4378-8f0e-caa7a37513b3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.424922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38044fcb-ef00-4378-8f0e-caa7a37513b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.425008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38044fcb-ef00-4378-8f0e-caa7a37513b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.427655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38044fcb-ef00-4378-8f0e-caa7a37513b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.427918] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38044fcb-ef00-4378-8f0e-caa7a37513b3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.794200] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31518b2-675c-4e16-bc68-e78685912b4e in Status: SUCCESS [ 786.794526] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31518b2-675c-4e16-bc68-e78685912b4e deletion is rescheduled due to dependency. [ 786.795034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.915484] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f700cdc4-7865-4ed9-a3bd-33949b66a130 with status ACTIVE [ 786.915689] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.915985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.915985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.916131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.916131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.916387] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.916510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.916510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.916704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.916704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.916900] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.917087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.917087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.917314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.917314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.917314] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f700cdc4-7865-4ed9-a3bd-33949b66a130 is going to be updated. [ 786.918430] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.922426] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.922587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.934972] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38044fcb-ef00-4378-8f0e-caa7a37513b3 [ 786.935217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.935347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.935576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.935634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.935695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.935781] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38044fcb-ef00-4378-8f0e-caa7a37513b3 already deleted. [ 786.935858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38044fcb-ef00-4378-8f0e-caa7a37513b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.947746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.948049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.948049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.948223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.948307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f700cdc4-7865-4ed9-a3bd-33949b66a130" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.075412] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 787.075412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.423653] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.708029] env[65162]: INFO networking_nsxv3.common.synchronization [None req-60a81e2a-54f7-4700-ad32-6c500beda4d1 None None] Enqueued Resource ID: 6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5 with Priority: HIGHEST for action port [ 787.708029] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5 with Priority: HIGHEST for action port [ 787.708029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.708029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.708029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.708029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.708029] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.717928] env[65162]: INFO networking_nsxv3.common.synchronization [req-f2bdebd9-c295-4196-9acb-9b4a50c10a58 req-ab4e7751-4b75-4dd1-a1f5-6157f82b40c4 tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_members [ 787.719222] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_members [ 787.719222] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.719697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.719863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.720740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.720740] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.720740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.720997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.721157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.721937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.721937] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.930462] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.931932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.933856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.933856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.933856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.933856] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 is going to be created. [ 787.962057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.962057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.962057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.964288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.964288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.977764] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 in Status: UNINITIALIZED for 2s [ 788.165197] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.165627] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.165672] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.165958] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.166283] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.166497] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.166591] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.166857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.167247] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.167308] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.167504] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.167570] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.167695] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.167931] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.167931] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.168127] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.188341] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.188530] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.188641] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.188847] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.189493] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.189493] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.189792] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.189906] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.190241] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.210516] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5 [ 788.210839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.210839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.210839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.211093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.211183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.211276] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5 already deleted. [ 788.211367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b8349d0-155b-4bfc-a9ec-6f083d2f6ea5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.228830] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.229071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.229491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.230113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.230113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.230749] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.230873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.230950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.231155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.231287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.231547] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 already deleted. [ 788.231713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.692829] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.693366] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.693783] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.694105] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.694260] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.694477] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 not found, creating... [ 788.694910] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.695090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.695206] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.695501] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.695637] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.696128] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.696263] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.696377] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.696706] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.696844] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.696979] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 is going to be created. [ 788.720858] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.721200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.721336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.721608] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.723310] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.723574] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.026860] env[65162]: INFO networking_nsxv3.common.synchronization [req-0e3fa3e4-4555-4c95-a134-4d433590ae9a req-b193e27a-d912-4332-af58-65050e3c88a4 tempest-InstanceActionsNegativeTestJSON-2012875378 tempest-InstanceActionsNegativeTestJSON-2012875378-project-member] Enqueued Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_members [ 789.028442] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGHEST for action security_group_members [ 789.028817] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.029017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.029156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.029444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.029722] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.029853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.029942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.030123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.030227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.030349] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.464779] env[65162]: INFO networking_nsxv3.common.synchronization [req-f2bdebd9-c295-4196-9acb-9b4a50c10a58 req-6e5901c2-c827-4205-8fbd-e50b30fc3a32 service nova] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_rules [ 789.465156] env[65162]: INFO networking_nsxv3.common.synchronization [req-f2bdebd9-c295-4196-9acb-9b4a50c10a58 req-6e5901c2-c827-4205-8fbd-e50b30fc3a32 service nova] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_members [ 789.465156] env[65162]: INFO networking_nsxv3.common.synchronization [req-f2bdebd9-c295-4196-9acb-9b4a50c10a58 req-6e5901c2-c827-4205-8fbd-e50b30fc3a32 service nova] Enqueued Resource ID: 9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 with Priority: HIGHEST for action port [ 789.465789] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_rules [ 789.465951] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_members [ 789.466420] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 with Priority: HIGHEST for action port [ 789.466898] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.466898] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.467057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.467236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.467340] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.468298] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.468410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.468479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.468664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.468841] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.468947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.469039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.469210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.469302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.469397] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.470283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.470357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.470419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.470575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.470649] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.532426] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.532603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.532603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.532756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.532854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.533066] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.533168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.533337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.533588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.533706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.533806] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 is going to be updated. [ 789.564153] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.564153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.564153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.564153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.564153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.575101] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 in Status: IN_PROGRESS for 2s [ 789.972378] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.976481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.976481] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 with status ACTIVE [ 789.976481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.976481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.976481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.976481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.976953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.976953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.976953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.976953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.976953] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771 is going to be updated. [ 789.991556] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 in Status: SUCCESS [ 789.991899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.992227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.992487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.992974] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.992974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.992974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.993231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.993231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.993231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.993390] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.004661] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.004879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.004879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.005110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.005816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.005816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bfbf8cb-a2ed-4b83-b0b6-eb6efd5ae771" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.475382] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.496541] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.496541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.496541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.496862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.496993] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.497163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.497241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.497424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.497589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.497706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.497839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.497957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.498035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.498236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.498418] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.498526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.498621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.498734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.498814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.498900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.498995] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.977758] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.977928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.978042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.978228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.978425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.978425] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 is going to be created. [ 791.003955] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.004181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.004367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.004559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.004758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.007569] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be9d78f4-56f5-4314-9b4c-a33024af1fa8: rpc.has_security_group_logging(os_id): False [ 791.020409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: UNINITIALIZED for 2s [ 791.025677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.025677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.025900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.025900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.026008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.026749] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.026749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.026749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.026915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.026948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.027138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.027287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.027391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.027598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.027725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.027976] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.028495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.028603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.028784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.028861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.028948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 is going to be created. [ 791.095518] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.096082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.096246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.096692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.108016] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 in Status: IN_PROGRESS for 2s [ 791.586114] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 in Status: SUCCESS [ 791.586405] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 deletion is rescheduled due to dependency. [ 791.586441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.269836] env[65162]: INFO networking_nsxv3.common.synchronization [req-9c9f04cb-6f68-4efb-a99f-472225ddd799 req-4ab12d3c-2182-4f6f-9d62-7025a2c5e86a tempest-ServersAdminNegativeTestJSON-1297608031 tempest-ServersAdminNegativeTestJSON-1297608031-project-member] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 792.270426] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 792.270748] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.270868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.271069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.273806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.274744] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.274744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.274744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.274744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.274744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.274744] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.747071] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.747071] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.747071] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.747071] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.748547] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.748823] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.748899] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.749185] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.749332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.749559] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.749671] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.750369] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.750369] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.750369] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.750369] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.750369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.772477] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.772477] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.772477] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.772676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-976" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.773292] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.773292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.773485] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.775340] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.775340] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59a5b38d-6b8e-41f9-a252-0ca0760ccb51',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.778109] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.030749] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: SUCCESS [ 793.030975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.031210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.031494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.031720] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.031906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.031981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.032160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.032263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.032363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.032463] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.121036] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 in Status: SUCCESS [ 793.121214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.276724] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.276925] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.277055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.277350] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.277540] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.277863] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 59a5b38d-6b8e-41f9-a252-0ca0760ccb51 not found, creating... [ 793.278020] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.278189] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.278298] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.278538] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.278650] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.278928] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.279096] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.279193] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.279394] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.279525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.279660] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 59a5b38d-6b8e-41f9-a252-0ca0760ccb51 is going to be created. [ 793.285019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.304536] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.304655] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.304733] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.305021] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.305276] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.305527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.523176] env[65162]: INFO networking_nsxv3.common.synchronization [req-f8b7dd76-1f49-4cb6-a876-d9f3b1edc807 req-89a9648d-1cba-4d1c-8f25-00c72db43a81 tempest-ServersNegativeTestJSON-1754726929 tempest-ServersNegativeTestJSON-1754726929-project-member] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 793.523736] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 793.524170] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.524402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.524493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.524693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.524847] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.524972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.525035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.525170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.525258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.525401] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.535408] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.786199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.788903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.788987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.789209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.789296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.789397] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be updated. [ 793.834026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.834026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.834026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.834026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.834026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.849635] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 794.029343] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.037493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7: rpc.has_security_group_logging(os_id): False [ 794.051240] env[65162]: INFO networking_nsxv3.common.synchronization [req-9c9f04cb-6f68-4efb-a99f-472225ddd799 req-388b270c-38ec-4d7c-a355-a0ed27353ad5 service nova] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_rules [ 794.051240] env[65162]: INFO networking_nsxv3.common.synchronization [req-9c9f04cb-6f68-4efb-a99f-472225ddd799 req-388b270c-38ec-4d7c-a355-a0ed27353ad5 service nova] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 794.051240] env[65162]: INFO networking_nsxv3.common.synchronization [req-9c9f04cb-6f68-4efb-a99f-472225ddd799 req-388b270c-38ec-4d7c-a355-a0ed27353ad5 service nova] Enqueued Resource ID: 59a5b38d-6b8e-41f9-a252-0ca0760ccb51 with Priority: HIGHEST for action port [ 794.051240] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_rules [ 794.051240] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 794.051240] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59a5b38d-6b8e-41f9-a252-0ca0760ccb51 with Priority: HIGHEST for action port [ 794.051240] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.051240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.051240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.051601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.051601] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.052638] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.052802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.053217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.053217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.053217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.054147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.054147] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59a5b38d-6b8e-41f9-a252-0ca0760ccb51',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.055892] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.056122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.056239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.057186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.057186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.057186] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.057186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.057186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.057606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.057733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.058112] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 is going to be created. [ 794.122438] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.122730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.122818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.123039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.123219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.135877] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: IN_PROGRESS for 2s [ 794.531534] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.556704] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.556831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.557050] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59a5b38d-6b8e-41f9-a252-0ca0760ccb51 with status ACTIVE [ 794.557229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.557341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.557396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.557607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.557695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.557866] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.557987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.558039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.558183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.558260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.558445] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.558539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.558611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.558746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.558827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.558889] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59a5b38d-6b8e-41f9-a252-0ca0760ccb51 is going to be updated. [ 794.585950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.586123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.586421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.586421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.586552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.586682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59a5b38d-6b8e-41f9-a252-0ca0760ccb51" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.034011] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.036289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.036289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.036289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.036289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.036289] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 795.073035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.073255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.073396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.074770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.074971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.094873] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 795.859097] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 795.859355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.859564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.859810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.860050] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.860203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.860286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.860514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.860615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.860752] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.149588] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: SUCCESS [ 796.149890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.364534] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.867127] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.103238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 797.103569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.371138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.371446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.371446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.373385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.373385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.373385] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be updated. [ 797.405680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.405902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.406062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.406477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.406662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.417559] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 797.726417] env[65162]: INFO networking_nsxv3.common.synchronization [None req-be6afb20-bb4d-4932-855e-2271ba44e6bf None None] Enqueued Resource ID: 6ab8a51b-44c2-4b52-b534-84e207f2ceb4 with Priority: HIGHEST for action port [ 797.727099] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab8a51b-44c2-4b52-b534-84e207f2ceb4 with Priority: HIGHEST for action port [ 797.727471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab8a51b-44c2-4b52-b534-84e207f2ceb4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.727570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab8a51b-44c2-4b52-b534-84e207f2ceb4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.727626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab8a51b-44c2-4b52-b534-84e207f2ceb4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.727906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab8a51b-44c2-4b52-b534-84e207f2ceb4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.727990] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab8a51b-44c2-4b52-b534-84e207f2ceb4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.992497] env[65162]: INFO networking_nsxv3.common.synchronization [req-7a48fdb8-c6b4-4acf-9f9b-67455f796061 req-51d4fdba-8f86-47f3-b9f6-44634cea62f8 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 797.992497] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 797.992727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.992863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.992910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.994220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.994350] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.994521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.994572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.994712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.994796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.994931] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.177210] env[65162]: INFO networking_nsxv3.common.synchronization [req-20a2faa1-7200-449e-ae61-135ec3b14933 req-c86da057-2d74-45dc-918d-e4a85bdd84da tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 798.177593] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 798.178136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.180258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.180258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.180258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.180921] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.180921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.181119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.182040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.182040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.182040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.231934] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ab8a51b-44c2-4b52-b534-84e207f2ceb4 [ 798.232302] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.232531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.232616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.232828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.232949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.233173] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ab8a51b-44c2-4b52-b534-84e207f2ceb4 already deleted. [ 798.233285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab8a51b-44c2-4b52-b534-84e207f2ceb4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.497103] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.498252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.498252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.498791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e already deleted. [ 798.498791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.634181] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-331 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.634181] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-331" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.636284] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-331" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.637079] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-331" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.637377] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.637549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.637664] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.638837] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.638837] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.638837] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.638837] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.638837] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.638837] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.638837] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.638837] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.639135] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.660484] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.660713] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.660790] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.660958] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-331" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.661391] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-31a6ff26-d421-451e-973d-bc991354e390 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.661483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.661850] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.662185] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.662349] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a6ff26-d421-451e-973d-bc991354e390',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.685893] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.166371] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.166371] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.166371] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.166371] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.166635] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.166635] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 31a6ff26-d421-451e-973d-bc991354e390 not found, creating... [ 799.167091] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.167091] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.167205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.167390] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.167518] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.167776] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.168691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.168691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.168691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.168691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.168691] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 31a6ff26-d421-451e-973d-bc991354e390 is going to be created. [ 799.193146] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.203588] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.203588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.203588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.203588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.203588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.203893] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.433637] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.433637] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.433637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.434411] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.698657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.698657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.698657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.698657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.698657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.698657] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 799.743096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.743096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.743096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.743304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.743565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.754328] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 799.941254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.941254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.941254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.941254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.941254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.942076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.942076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.942076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.942076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.942076] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.994189] env[65162]: INFO networking_nsxv3.common.synchronization [req-7a48fdb8-c6b4-4acf-9f9b-67455f796061 req-85f177d7-a6e8-4d26-86b8-9cf087572149 service nova] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 799.994189] env[65162]: INFO networking_nsxv3.common.synchronization [req-7a48fdb8-c6b4-4acf-9f9b-67455f796061 req-85f177d7-a6e8-4d26-86b8-9cf087572149 service nova] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 799.994189] env[65162]: INFO networking_nsxv3.common.synchronization [req-7a48fdb8-c6b4-4acf-9f9b-67455f796061 req-85f177d7-a6e8-4d26-86b8-9cf087572149 service nova] Enqueued Resource ID: 31a6ff26-d421-451e-973d-bc991354e390 with Priority: HIGHEST for action port [ 799.994640] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 799.994819] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 799.994981] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a6ff26-d421-451e-973d-bc991354e390 with Priority: HIGHEST for action port [ 799.995219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.995352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.995411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.995582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.995681] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.997660] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.997660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.997660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.998055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.998055] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.998479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.000498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.000498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.000498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.000498] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.001429] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a6ff26-d421-451e-973d-bc991354e390 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.001429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.001610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.001610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.001721] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a6ff26-d421-451e-973d-bc991354e390',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.321339] env[65162]: INFO networking_nsxv3.common.synchronization [None req-66f53ec8-9f92-44a5-b87f-3b32464f399b None None] Enqueued Resource ID: 7d608368-64a5-4a2a-aa13-5ffa017b636c with Priority: HIGHEST for action port [ 800.321664] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d608368-64a5-4a2a-aa13-5ffa017b636c with Priority: HIGHEST for action port [ 800.322484] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d608368-64a5-4a2a-aa13-5ffa017b636c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.322484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d608368-64a5-4a2a-aa13-5ffa017b636c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.322668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d608368-64a5-4a2a-aa13-5ffa017b636c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.323881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d608368-64a5-4a2a-aa13-5ffa017b636c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.323881] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d608368-64a5-4a2a-aa13-5ffa017b636c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.445936] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcdff5a2-f30c-4336-a8cd-e116d208fd7d: rpc.has_security_group_logging(os_id): False [ 800.467035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.467197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.467281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.467510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.467610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.467805] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.467908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.467971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.468168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.468249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.468447] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.468559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.468619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.468781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.468859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.471496] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.471688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.471730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.472019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.472142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.472281] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be updated. [ 800.506190] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.506190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.506190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.506190] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31a6ff26-d421-451e-973d-bc991354e390 with status ACTIVE [ 800.506190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.506190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.506190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.506616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.506616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.506674] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.506799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.506896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.508410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.508527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.509149] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.509394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.509671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.509949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.510097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.510382] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31a6ff26-d421-451e-973d-bc991354e390 is going to be updated. [ 800.537822] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.537998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.538064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.539066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.539066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.539066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.565026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.565026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.565026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.565026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.565026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.568096] env[65162]: INFO networking_nsxv3.common.synchronization [req-60575aa7-1f32-4523-8349-bcb41437de6b req-9a30b334-28cc-4a57-8421-9389cf1886d6 tempest-InstanceActionsV221TestJSON-1307410940 tempest-InstanceActionsV221TestJSON-1307410940-project-member] Enqueued Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_members [ 800.574899] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_members [ 800.574899] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.574899] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.574899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.574899] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.583726] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 800.830062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d608368-64a5-4a2a-aa13-5ffa017b636c [ 800.831949] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.831949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.831949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.831949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.836120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.836120] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d608368-64a5-4a2a-aa13-5ffa017b636c already deleted. [ 800.836120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d608368-64a5-4a2a-aa13-5ffa017b636c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.013689] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.019018] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-552" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-552" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-552" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.019018] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.019018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.019018] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.019018] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.019018] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.019018] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.019672] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.019672] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.019672] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.042424] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.042766] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.043264] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.043810] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-552" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.044727] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-6861f3d4-a115-4b20-81ce-890187af644d taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.045643] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.046980] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.047593] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.048386] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6861f3d4-a115-4b20-81ce-890187af644d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.081565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.081565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.081565] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 already deleted. [ 801.081565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.300926] env[65162]: INFO networking_nsxv3.common.synchronization [None req-302b509a-bdf4-43bb-bbf7-6195ad1a737a None None] Enqueued Resource ID: fd3d9285-a720-46f0-a8ba-ff6c20b77f35 with Priority: HIGHEST for action port [ 801.301806] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3d9285-a720-46f0-a8ba-ff6c20b77f35 with Priority: HIGHEST for action port [ 801.302223] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd3d9285-a720-46f0-a8ba-ff6c20b77f35 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.303758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd3d9285-a720-46f0-a8ba-ff6c20b77f35" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.303880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd3d9285-a720-46f0-a8ba-ff6c20b77f35" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.304232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd3d9285-a720-46f0-a8ba-ff6c20b77f35" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.304346] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd3d9285-a720-46f0-a8ba-ff6c20b77f35',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.522522] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.522811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.522811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.523036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.523142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.523236] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be created. [ 801.551849] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.552145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.552145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.552324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.552848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.553888] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.555318] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.555440] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.555789] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.557158] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.557158] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 6861f3d4-a115-4b20-81ce-890187af644d not found, creating... [ 801.557158] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.558508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.558666] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.558963] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.559152] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.559558] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.560210] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.560210] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.560459] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.561058] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.561058] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 6861f3d4-a115-4b20-81ce-890187af644d is going to be created. [ 801.576315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: UNINITIALIZED for 2s [ 801.590079] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.590446] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.590572] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.590877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.591102] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.591324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.766525] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 801.767607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.806383] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd3d9285-a720-46f0-a8ba-ff6c20b77f35 [ 801.806738] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.806877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.806877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.807061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.807153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.807251] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd3d9285-a720-46f0-a8ba-ff6c20b77f35 already deleted. [ 801.807333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd3d9285-a720-46f0-a8ba-ff6c20b77f35" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.381945] env[65162]: INFO networking_nsxv3.common.synchronization [req-60575aa7-1f32-4523-8349-bcb41437de6b req-73e6719a-2380-46c7-a79c-6291bddb2f09 service nova] Enqueued Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_rules [ 802.382275] env[65162]: INFO networking_nsxv3.common.synchronization [req-60575aa7-1f32-4523-8349-bcb41437de6b req-73e6719a-2380-46c7-a79c-6291bddb2f09 service nova] Enqueued Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_members [ 802.382275] env[65162]: INFO networking_nsxv3.common.synchronization [req-60575aa7-1f32-4523-8349-bcb41437de6b req-73e6719a-2380-46c7-a79c-6291bddb2f09 service nova] Enqueued Resource ID: 6861f3d4-a115-4b20-81ce-890187af644d with Priority: HIGHEST for action port [ 802.382572] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_rules [ 802.382712] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_members [ 802.382827] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6861f3d4-a115-4b20-81ce-890187af644d with Priority: HIGHEST for action port [ 802.386435] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.386943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.386943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.387092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.387092] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.388159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.388278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.388425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.391179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.391179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.391179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.391361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.391404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.393705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.393705] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.393705] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6861f3d4-a115-4b20-81ce-890187af644d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.393705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.393705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.393705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.393705] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6861f3d4-a115-4b20-81ce-890187af644d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.600964] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 802.600964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.895477] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.895477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.896428] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.897257] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6861f3d4-a115-4b20-81ce-890187af644d with status ACTIVE [ 802.897447] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.897563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.897626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.897827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.897908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.898096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.898189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.898247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.898397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.898467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.898634] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.898721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.898779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.898912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.898980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.901195] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6861f3d4-a115-4b20-81ce-890187af644d is going to be updated. [ 802.926570] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.926570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.926570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.926570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.926570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.926570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6861f3d4-a115-4b20-81ce-890187af644d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.403220] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.588803] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 803.589701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.589701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.589701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.589701] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.589701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.589925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.589925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.590011] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.590078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.590170] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.910359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.910359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.910359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.910359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.910359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.910359] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 is going to be created. [ 803.915059] env[65162]: INFO networking_nsxv3.common.synchronization [None req-7990b663-06c7-4176-a00c-2c1a22e8d310 None None] Enqueued Resource ID: bc391004-4d68-486e-9c03-5390aef5715d with Priority: HIGHEST for action port [ 803.916153] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc391004-4d68-486e-9c03-5390aef5715d with Priority: HIGHEST for action port [ 803.916926] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc391004-4d68-486e-9c03-5390aef5715d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.916995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc391004-4d68-486e-9c03-5390aef5715d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.917121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc391004-4d68-486e-9c03-5390aef5715d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.917399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc391004-4d68-486e-9c03-5390aef5715d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.917494] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc391004-4d68-486e-9c03-5390aef5715d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.941979] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.944029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.944029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.944029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.944029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.954822] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 in Status: UNINITIALIZED for 2s [ 804.095364] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.421988] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc391004-4d68-486e-9c03-5390aef5715d [ 804.422586] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.422586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.422586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.422765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.422856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.422967] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc391004-4d68-486e-9c03-5390aef5715d already deleted. [ 804.423198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc391004-4d68-486e-9c03-5390aef5715d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.596709] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56db26ed-c49a-44f4-95c8-7daf9b19435e: rpc.has_security_group_logging(os_id): False [ 804.618229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.618566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.618916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.619727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.619871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.620210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.620382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.620453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.620806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.620806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.620910] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be created. [ 804.699756] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.700067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.701411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.701973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.704789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.718180] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 805.968603] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 in Status: SUCCESS [ 805.969055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.969055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.969362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.969446] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.969575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.969635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.969795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.969874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.969990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.970058] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.474271] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.474271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.474271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.474872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.474872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.477628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.477714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.477941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.478050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.478154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.478669] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.478669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.478669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.478669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.478911] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.479326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.479326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.479426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.479468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.479521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.479645] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.669625] env[65162]: INFO networking_nsxv3.common.synchronization [req-efc1cb75-f327-4977-bc35-3991aa41006b req-1e0522a3-7ee1-41a5-a3da-bf9361abff0d tempest-VolumesAdminNegativeTest-1239067301 tempest-VolumesAdminNegativeTest-1239067301-project-member] Enqueued Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_members [ 806.671354] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGHEST for action security_group_members [ 806.672525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.672525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.672525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.672525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.672525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.672525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.672882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.672882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.672882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.673033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.733820] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 806.733820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.982023] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8d82595-19fb-4678-9933-9ad14fdf5ab6: rpc.has_security_group_logging(os_id): False [ 807.002396] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.002554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.002554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.002754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.002843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.003041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.003142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.003227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.003398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.003479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.003680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.003775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.003835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.003972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.004167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.004225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.004320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.004375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.004554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.004638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.004707] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 is going to be created. [ 807.066834] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.067315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.070116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.070116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.070116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.081389] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 in Status: IN_PROGRESS for 2s [ 807.177363] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.177551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.177601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.178527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.178527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.178527] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.178527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.178727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.178804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.178851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.178918] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 is going to be updated. [ 807.227324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.227525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.227583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.227824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.227972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.256235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 in Status: IN_PROGRESS for 2s [ 809.096420] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 in Status: SUCCESS [ 809.096721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.163841] env[65162]: INFO networking_nsxv3.common.synchronization [req-995b58b8-3717-4965-92c1-cf52c25be362 req-c3218077-6789-4d5a-b989-286a58a3493e tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 809.164445] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 809.164730] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.164840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.164910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.165122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.165290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.165387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.165443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.165596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.165684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.165774] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.267991] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 in Status: SUCCESS [ 809.267991] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 deletion is rescheduled due to dependency. [ 809.268182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.563735] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.564391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.564391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.564391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.564717] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.564894] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.565018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.565263] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.565424] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.565661] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.565801] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.565931] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.566077] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.566225] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.566334] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.566462] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.587272] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.587272] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.587272] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.587272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.587498] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-9cbfd20b-0e8c-4641-8853-bcadaf982944 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.587599] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.587769] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.588094] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.588309] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbfd20b-0e8c-4641-8853-bcadaf982944',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.668333] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.668508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.668579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.668798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.668909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.669141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.669244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.669317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.669486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.669569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.669657] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 809.702678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.703691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.703691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.703691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.703691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.714925] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 810.091996] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.091996] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.092510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.092510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.093047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.093047] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 9cbfd20b-0e8c-4641-8853-bcadaf982944 not found, creating... [ 810.093339] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.093553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.093724] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.094093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.094710] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.094710] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.095018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.095186] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.095527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.095758] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.095972] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 9cbfd20b-0e8c-4641-8853-bcadaf982944 is going to be created. [ 810.129688] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.129688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.129688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.129688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.129688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.129688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.836248] env[65162]: INFO networking_nsxv3.common.synchronization [req-995b58b8-3717-4965-92c1-cf52c25be362 req-c25d0cb7-c925-4686-be0a-2b88e8513764 service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 810.836248] env[65162]: INFO networking_nsxv3.common.synchronization [req-995b58b8-3717-4965-92c1-cf52c25be362 req-c25d0cb7-c925-4686-be0a-2b88e8513764 service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 810.836248] env[65162]: INFO networking_nsxv3.common.synchronization [req-995b58b8-3717-4965-92c1-cf52c25be362 req-c25d0cb7-c925-4686-be0a-2b88e8513764 service nova] Enqueued Resource ID: 9cbfd20b-0e8c-4641-8853-bcadaf982944 with Priority: HIGHEST for action port [ 810.836393] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 810.836432] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 810.836759] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbfd20b-0e8c-4641-8853-bcadaf982944 with Priority: HIGHEST for action port [ 810.837082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.837209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.837494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.837551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.837642] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.838631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.838744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.838965] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cbfd20b-0e8c-4641-8853-bcadaf982944 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.839090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.839162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.839375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.839573] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbfd20b-0e8c-4641-8853-bcadaf982944',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.953135] env[65162]: INFO networking_nsxv3.common.synchronization [req-dfe2cbf1-0f44-4701-b458-195b0604fcdc req-1e2ca015-771c-4d52-b351-9a16b82dd1ee tempest-ServersAdminNegativeTestJSON-1297608031 tempest-ServersAdminNegativeTestJSON-1297608031-project-member] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 810.953626] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 810.953928] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.954061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.954129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.954314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.954459] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.954591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.954644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.954780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.954866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.954961] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.343409] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.343701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.343742] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cbfd20b-0e8c-4641-8853-bcadaf982944 with status ACTIVE [ 811.343894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.344015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.344112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.344408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.344408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.344569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.344676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.344710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.344838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.344914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.345100] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.345193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.345259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.345403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.345500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.345619] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cbfd20b-0e8c-4641-8853-bcadaf982944 is going to be updated. [ 811.372086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.372255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.372327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.372584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.372725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.372901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cbfd20b-0e8c-4641-8853-bcadaf982944" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.462024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.725911] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 811.726172] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 811.726217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.726370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.726569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.726744] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.726882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.727151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.727151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.727222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.727275] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.962774] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.231054] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.465574] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.465574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.465574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.466137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.466137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.466137] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be updated. [ 812.493478] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.493744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.493744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.493883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.493995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.503711] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 812.734179] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.044045] env[65162]: INFO networking_nsxv3.common.synchronization [req-49fc5dbb-8207-4931-97db-d4d0c4a714fe req-c46e641d-3e4e-4c49-8a89-d22da857f8f5 tempest-ServerActionsV293TestJSON-1615156236 tempest-ServerActionsV293TestJSON-1615156236-project-member] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_members [ 813.044679] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGHEST for action security_group_members [ 813.044989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.046844] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.046844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.046844] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.235574] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.235768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.235842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.236072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.236503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.236615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 813.266686] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.266764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.266797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.267166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.267166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.287243] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 813.548882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.548882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.548882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.549355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.549355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.549355] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.549500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.549500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.549638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.549718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.549807] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 is going to be updated. [ 813.576194] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.576376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.576442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.577031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.577031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.589174] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 in Status: IN_PROGRESS for 2s [ 814.142577] env[65162]: INFO networking_nsxv3.common.synchronization [req-5fc6c4fa-6ba2-4dcf-8b21-d93467ae5efb req-c5ac3526-2502-4871-8eb4-5b5895655f9c tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 814.143124] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 814.143423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.143547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.143617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.143870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.144039] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.144146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.144210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.144393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.144526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.144711] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.513904] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 814.514177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.648032] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.648032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.648032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.648032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.648032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.648525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.648525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.648525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.648525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.648681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.648681] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 already deleted. [ 814.648917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.682710] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.682710] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.684574] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.685950] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.686803] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.687073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.687377] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.688486] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.688739] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.689014] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.689247] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.689493] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.689778] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.689940] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.690098] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.690379] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.713963] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.714136] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.714342] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.715964] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.716475] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.716733] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.717019] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.717511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.717725] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.030737] env[65162]: INFO networking_nsxv3.common.synchronization [req-e5ebbb26-046e-474b-80ec-4850b0e871c7 req-fdaf9355-12e1-4ad4-b963-2fa589515aa2 tempest-InstanceActionsV221TestJSON-1307410940 tempest-InstanceActionsV221TestJSON-1307410940-project-member] Enqueued Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_members [ 815.031389] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 with Priority: HIGHEST for action security_group_members [ 815.031735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8d82595-19fb-4678-9933-9ad14fdf5ab6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.032040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.032114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.032382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.032551] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.032662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.032728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.032882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.033123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.033206] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8d82595-19fb-4678-9933-9ad14fdf5ab6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.220385] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.220603] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.220711] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.221019] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.221168] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.221323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 not found, creating... [ 815.221678] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.221829] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.221940] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.222253] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.222450] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.222873] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.223040] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.223163] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.223381] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.223518] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.223657] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 is going to be created. [ 815.246597] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.247032] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.247217] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.247504] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.247763] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.248060] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.305500] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.305500] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.305500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.305500] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.535544] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.536111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.536214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.536430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.536537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.536933] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.536933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.536933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.537205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.537205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.537671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 is going to be updated. [ 815.567517] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.567517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.567517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.567517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.567762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.576868] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 in Status: IN_PROGRESS for 2s [ 815.597747] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 in Status: SUCCESS [ 815.597995] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 deletion is rescheduled due to dependency. [ 815.598244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.811798] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.812099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.812099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.812266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.812447] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.812560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.812626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.812781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.812867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.812955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.813712] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.814469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.814618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.814760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.814915] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.814997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.815067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.815212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.815288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.815397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.815451] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.848156] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.848156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.848156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.848156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.848156] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.955445] env[65162]: INFO networking_nsxv3.common.synchronization [req-5fc6c4fa-6ba2-4dcf-8b21-d93467ae5efb req-251b93e6-ae7a-4442-8033-a5c2961c8ced service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 815.955573] env[65162]: INFO networking_nsxv3.common.synchronization [req-5fc6c4fa-6ba2-4dcf-8b21-d93467ae5efb req-251b93e6-ae7a-4442-8033-a5c2961c8ced service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 815.955705] env[65162]: INFO networking_nsxv3.common.synchronization [req-5fc6c4fa-6ba2-4dcf-8b21-d93467ae5efb req-251b93e6-ae7a-4442-8033-a5c2961c8ced service nova] Enqueued Resource ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 with Priority: HIGHEST for action port [ 815.956477] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 815.956557] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 815.956597] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 with Priority: HIGHEST for action port [ 815.956867] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.956982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.957655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.957910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.957999] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.958867] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.958990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.959078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.959905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.959905] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.959905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.959905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.959905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.959905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.959905] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.960734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.960734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.960734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.961031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.961031] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.319806] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55eb5d3-a252-4f36-9046-1505d8f8fa4e: rpc.has_security_group_logging(os_id): False [ 816.340912] env[65162]: INFO networking_nsxv3.common.synchronization [req-b721206c-053c-48f3-8c1d-35d063068f73 req-9cf0f996-3964-4057-9d80-198cc14bb3a2 tempest-ServersTestFqdnHostnames-248459309 tempest-ServersTestFqdnHostnames-248459309-project-member] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_members [ 816.340912] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGHEST for action security_group_members [ 816.341311] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.341654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.341654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.341810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.342055] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.342195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.343234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.343234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.343390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.344314] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.350910] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.380063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.380063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.380063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.380063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.380063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.380063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.380063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.380063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.380412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.380412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.380412] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.380515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.380515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.380649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.380713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.380908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.381249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.381403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.381596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.381821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.381994] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 816.461123] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.461123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.461123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.461123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.461123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.462471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.462471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.463562] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 with status ACTIVE [ 816.463562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.463562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.467434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.467774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.467959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.468382] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.469292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.469360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.469498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.469578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.469775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.469940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.470106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.471758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.471758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.471758] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 is going to be updated. [ 816.472042] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.488596] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 816.495252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.495404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.495470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.495920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.496047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.496248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.848313] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.851405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.851405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.851405] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d8d01f-0537-475c-a915-12d156922e75 is going to be updated. [ 816.854504] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.881090] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.881090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.881090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.881406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.881687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.897308] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d8d01f-0537-475c-a915-12d156922e75 in Status: IN_PROGRESS for 2s [ 816.977117] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.356336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 817.357909] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 817.483108] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.484175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.484175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.484175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.484175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.484175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be created. [ 817.513227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.513400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.513505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.513663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.513873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.540179] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: UNINITIALIZED for 2s [ 817.587625] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 in Status: SUCCESS [ 817.587750] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8d82595-19fb-4678-9933-9ad14fdf5ab6 deletion is rescheduled due to dependency. [ 817.587872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8d82595-19fb-4678-9933-9ad14fdf5ab6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.311233] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.311233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.311233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.311233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.326071] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 818.326863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.327965] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 818.368142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.368142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.368142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.368142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.374704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.375507] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 818.375507] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60'} {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 818.375507] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 818.422279] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.422595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.422751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.423110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.424760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.425037] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 818.502971] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 818.503504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.507288] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.507483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.507556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.507824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.508073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.508310] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 818.582348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.582646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.582646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.582958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.583397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.583515] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 818.583640] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'521e5e7b-7b42-4883-9df9-2190fd9e6337', '4c367c1a-4f7d-4875-9d05-179a78da6584', 'afc090b2-bc85-4f97-aa84-42fe4b3085b7', 'a31518b2-675c-4e16-bc68-e78685912b4e', '1a02c478-9c75-420c-a387-bc52bfa702cb', 'bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7', 'e6661d9a-0a2f-4ad7-a804-9e5004aa95db', '24634bde-1ed8-4d4f-9db6-b19816b628d7', '4dd59e3c-797c-4664-8f76-fa18f1a811b1', 'dcdff5a2-f30c-4336-a8cd-e116d208fd7d', '42d8d01f-0537-475c-a915-12d156922e75', '17b2580d-282c-4150-9de0-918d31fd8103', '542ab4ea-1934-47eb-b35d-a11a9e723c30', 'c4237fa3-bfbf-4636-ac25-550350b0ee05', 'f2880f64-bee4-45fb-88ef-a60ad0c676d2', 'b55eb5d3-a252-4f36-9046-1505d8f8fa4e', '9cd3c00c-bea5-4be8-872a-a7b4027d6035', 'b8f397b1-dc10-4ae4-92be-e4aad1bdbb08', '56db26ed-c49a-44f4-95c8-7daf9b19435e', 'f86c44d7-d532-4841-9243-c4031dd1f02d', '9998726b-c2cc-495a-9b94-43b9da32545d', '7f84ca5c-ce92-4db5-9d7f-838f30c85f1f', 'f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5', '523df74a-7dca-4c8d-a869-891ca0abbe71', '3335dfc0-bd35-4429-ae08-fe5e4847acff', '19a33b05-c764-41fc-b486-255a775ecff1', 'cc14b794-c440-4406-844c-ac39d23312a4', 'be9d78f4-56f5-4314-9b4c-a33024af1fa8', 'dd94e034-7289-4a18-8431-d4bba42b0823', '7b521adf-a3c4-47a4-a31d-e406ca77ccb7', '2f904e96-f18d-4ef1-be07-0c2f77a78a73', 'a8d82595-19fb-4678-9933-9ad14fdf5ab6', '76494ce4-3ed0-426c-ac36-271f9eef282c', 'ec0acf84-468d-4a9a-80be-4595d495629a'} {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 818.583750] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 818.606989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.607219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.607219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.607521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.607613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.607725] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 818.607844] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 818.607928] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 818.712245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.712506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.712588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.712955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.714202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.714415] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 818.714570] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 818.714705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 818.714804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 818.714929] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 with Priority: HIGH for action port [ 818.715065] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/34 resources of Type:Security Group Rules [ 818.715169] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGH for action security_group_rules [ 818.715274] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGH for action security_group_rules [ 818.715374] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGH for action security_group_rules [ 818.715470] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGH for action security_group_rules [ 818.715567] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGH for action security_group_rules [ 818.715820] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGH for action security_group_rules [ 818.716084] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGH for action security_group_rules [ 818.716116] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGH for action security_group_rules [ 818.716212] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGH for action security_group_rules [ 818.716328] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGH for action security_group_rules [ 818.716411] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGH for action security_group_rules [ 818.716501] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGH for action security_group_rules [ 818.716606] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGH for action security_group_rules [ 818.716711] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGH for action security_group_rules [ 818.716788] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGH for action security_group_rules [ 818.716854] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGH for action security_group_rules [ 818.716917] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGH for action security_group_rules [ 818.716979] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGH for action security_group_rules [ 818.717055] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGH for action security_group_rules [ 818.717156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.904343] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d8d01f-0537-475c-a915-12d156922e75 in Status: SUCCESS [ 818.904751] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d8d01f-0537-475c-a915-12d156922e75 deletion is rescheduled due to dependency. [ 818.904942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.550096] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 819.550443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.550500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.550686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.550879] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.550997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.551069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.551218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.551296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.551406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.551589] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.053986] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.131204] env[65162]: INFO networking_nsxv3.common.synchronization [req-7e7e2605-8744-47b2-835d-7e59bb62af81 req-946ada45-7d27-44a5-8861-89cfac3e973f tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 820.131756] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 820.131906] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 with Priority: HIGH for action port [ 820.132015] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGH for action security_group_rules [ 820.132121] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGH for action security_group_rules [ 820.133823] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 with Priority: HIGH for action security_group_rules [ 820.133980] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGH for action security_group_rules [ 820.134112] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 with Priority: HIGH for action security_group_rules [ 820.134251] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 with Priority: HIGH for action security_group_rules [ 820.134457] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGH for action security_group_rules [ 820.134658] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGH for action security_group_rules [ 820.134806] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGH for action security_group_rules [ 820.134942] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b2580d-282c-4150-9de0-918d31fd8103 with Priority: HIGH for action security_group_rules [ 820.135096] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8d01f-0537-475c-a915-12d156922e75 with Priority: HIGH for action security_group_rules [ 820.135236] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGH for action security_group_rules [ 820.135365] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGH for action security_group_rules [ 820.135886] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGH for action security_group_rules [ 820.136071] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGH for action security_group_rules [ 820.136188] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGH for action security_group_rules [ 820.136289] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31518b2-675c-4e16-bc68-e78685912b4e with Priority: HIGH for action security_group_rules [ 820.136395] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 with Priority: HIGH for action security_group_rules [ 820.136490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGH for action security_group_rules [ 820.136815] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.136948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.137437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.137755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.137927] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.138051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.138117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.139022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.139119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.139179] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.140580] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.140769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.140769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.140919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.141009] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.142229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.142713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.142713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.142876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.142876] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.145157] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.145157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.145157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.145157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.145157] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.146121] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4237fa3-bfbf-4636-ac25-550350b0ee05 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.146239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.146307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.146463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.146537] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4237fa3-bfbf-4636-ac25-550350b0ee05',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.147696] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.148042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.148112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.148186] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.149155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.149257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.149322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.149487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.149559] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f397b1-dc10-4ae4-92be-e4aad1bdbb08',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.153026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.153823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.153823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.153823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.153823] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd3c00c-bea5-4be8-872a-a7b4027d6035',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.157021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.157021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.157021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.157021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.157021] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.157021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.157021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.157021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.157021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.157021] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.157021] env[65162]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 820.157870] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.157973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.158119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.158357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.158477] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.160034] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17b2580d-282c-4150-9de0-918d31fd8103 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.160154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.160195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.160344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.160413] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17b2580d-282c-4150-9de0-918d31fd8103',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.161324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d8d01f-0537-475c-a915-12d156922e75 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.162035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.162132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.162296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.162369] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d8d01f-0537-475c-a915-12d156922e75',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.163245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.163348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.163406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.163555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.163622] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.164642] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.164721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.164790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.164942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.165424] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.166422] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.166527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.166595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.166762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.166838] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.168283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.168399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.168448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.168613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.168688] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.170014] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.170137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.170205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.170380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.170485] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.171436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a31518b2-675c-4e16-bc68-e78685912b4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.171551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.171620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.171877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.171954] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a31518b2-675c-4e16-bc68-e78685912b4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.172847] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521e5e7b-7b42-4883-9df9-2190fd9e6337 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.172950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.173036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.173213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.173294] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521e5e7b-7b42-4883-9df9-2190fd9e6337',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.173569] env[65162]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 820.174465] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.174593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.174672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.174813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.174884] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.181300] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.181449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.181524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.181766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.181868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.182132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.182251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.182315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.182489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.182575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.182745] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c already deleted. [ 820.182846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.532720] env[65162]: INFO networking_nsxv3.common.synchronization [req-0af65b40-9ebb-4cc1-ae95-3fbdb799ebe5 req-bfe111eb-c783-42ac-961f-af0fb1839595 tempest-ListImageFiltersTestJSON-70258688 tempest-ListImageFiltersTestJSON-70258688-project-member] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 820.533269] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 820.533577] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.533752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.533752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.533945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.539148] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.539148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.539148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.539148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.539148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.539148] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.564399] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ef750e-5b63-4b25-85ba-13ff2b01aab2: rpc.has_security_group_logging(os_id): False [ 820.565085] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.565375] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.565498] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.565854] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.566136] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.566303] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.567052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.567052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.567353] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.567690] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.567817] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.567927] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.568047] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.568158] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.568263] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.568395] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.589761] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.589944] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.590085] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.590258] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.590570] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.590956] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.590956] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.591181] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.591315] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ce0b48d-bdae-4783-8f4b-44c7dfb27090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.593939] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.594070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.594141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.594498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.594498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.594671] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.594768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.594830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.594975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.595392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.595505] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be created. [ 820.678772] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.678772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.678772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.679033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.679116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.680224] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 with status ACTIVE [ 820.680395] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.680496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.680558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.681087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.681087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.681087] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.681087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.681275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.681311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.682028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.682028] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.682028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.682028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.682028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.682028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.682028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60 is going to be updated. [ 820.683320] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.683414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.683478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.683623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.683756] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.683845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.683903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.684055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.684129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.684224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.684380] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.716504] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.716705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.716804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.717056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.717235] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.717336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.717401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.717561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.717648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.717732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.717840] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.721505] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.721636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.721713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.721873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.722047] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.722166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.722230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.722378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.722487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.722578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.722664] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.727015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.727153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.727217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.727443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.727603] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.727703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.727850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.728015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.728105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.728193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.728280] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.730910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.731146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.731260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.731442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.731596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.731695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.731759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.731902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.731983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.732081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.732170] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.734994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.735123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.735244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.735415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.735578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.735733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.735805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.735954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.736155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.736155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.736221] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.737452] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.737566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.737640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.737793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.737937] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.738044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.738108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.738248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.738327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.738415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.738741] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.744328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.744458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.744568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.744905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.745087] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.745226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.745259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.745396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.745477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.745565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.745655] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.746950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.747102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.747172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.747337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.747487] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.747585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.747644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.747782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.747862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.747945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.749068] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.751855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.752177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.752367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.752711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.752786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.752894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.752948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.753121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.753212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.753300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.753391] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.758292] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.758292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.758454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.758545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.758684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.758855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db188ca-6f0e-4f8b-b13a-b8ed2f4d7f60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.766148] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 820.812872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.813059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.813115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.813314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.815249] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.815435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.816249] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.816358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.817227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.817325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.818136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.818238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.835464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.835652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.836766] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.836888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.838139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.838255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.867666] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 820.868297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.868626] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f397b1-dc10-4ae4-92be-e4aad1bdbb08 is going to be deleted. [ 820.870029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.870029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.898160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.898369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521e5e7b-7b42-4883-9df9-2190fd9e6337 is going to be deleted. [ 820.899523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.899778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.927325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.927380] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be deleted. [ 820.928674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.929101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.983843] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.983843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.001212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.001212] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4237fa3-bfbf-4636-ac25-550350b0ee05 is going to be deleted. [ 821.001717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.001865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.019719] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.019896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.039671] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.087141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.087324] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be deleted. [ 821.088952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.090421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.098660] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.098896] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.099040] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.099470] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.099630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.099796] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 6ce0b48d-bdae-4783-8f4b-44c7dfb27090 not found, creating... [ 821.100102] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.100278] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.100403] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.100958] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.101129] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.101455] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.101701] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.102032] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.102300] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.102451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.102621] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 6ce0b48d-bdae-4783-8f4b-44c7dfb27090 is going to be created. [ 821.115145] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.115145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.125456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.125693] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17b2580d-282c-4150-9de0-918d31fd8103 is going to be deleted. [ 821.127295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.127538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.157168] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.157532] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.157645] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.157975] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.158275] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.158548] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.170066] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.170242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.186817] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.218852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.219264] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd3c00c-bea5-4be8-872a-a7b4027d6035 is going to be deleted. [ 821.220555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.220796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.224717] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.225680] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.235498] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.235706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.235770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.236023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.236207] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.236310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.236371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.236542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.236631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.236717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.236878] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.236970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.237051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.237200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.237490] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.237490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.237490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.237642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.237720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.237815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.237913] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.240625] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.247579] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.247804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.247887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.248169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.248286] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.248415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.248598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.248780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.248900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.249053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.249229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.249357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.249440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.249618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.249802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.249932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.250033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.250167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.250245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.250330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.250449] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.258038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.258038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.258038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.258038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.258299] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.259083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.259083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.259083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.259083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.259314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.259314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.259404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.259404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.260031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.260031] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.260031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.260031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.260031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.260031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.260456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.260456] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.261649] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.261882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.261882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.261969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.262083] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.262193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.262224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.262364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.262432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.262510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.262734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.263608] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.263608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.264240] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.265133] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.268916] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.269078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.269150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.270159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.270159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.270159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.270641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.270641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.270641] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.270641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.271573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.271573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.271573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.271573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.271573] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.302225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.302371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.320289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.320427] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31518b2-675c-4e16-bc68-e78685912b4e is going to be deleted. [ 821.322378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.323093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.363874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.364137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.389031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.389031] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d8d01f-0537-475c-a915-12d156922e75 is going to be deleted. [ 821.389031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.389031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.389031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.389031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f397b1-dc10-4ae4-92be-e4aad1bdbb08" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.389356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.389388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.389493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.389667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521e5e7b-7b42-4883-9df9-2190fd9e6337" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.390601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.391060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.391060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.391060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.391295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.391295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.391388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.391482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4237fa3-bfbf-4636-ac25-550350b0ee05" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.391613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.391753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.391827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.391939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.392081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.392220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.392294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.392400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17b2580d-282c-4150-9de0-918d31fd8103" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.433036] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.433676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.433676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.433676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.433676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.433676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd3c00c-bea5-4be8-872a-a7b4027d6035" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.480060] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.480060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.480060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.480060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.480480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.480480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a31518b2-675c-4e16-bc68-e78685912b4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.543057] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.553152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.553461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.553701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.554032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.554305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.554454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d8d01f-0537-475c-a915-12d156922e75" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.690712] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c367c1a-4f7d-4875-9d05-179a78da6584: rpc.has_security_group_logging(os_id): False [ 821.710208] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.710335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.710409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.710631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.728266] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a02c478-9c75-420c-a387-bc52bfa702cb: rpc.has_security_group_logging(os_id): False [ 821.732313] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7: rpc.has_security_group_logging(os_id): False [ 821.742852] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcdff5a2-f30c-4336-a8cd-e116d208fd7d: rpc.has_security_group_logging(os_id): False [ 821.746279] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56db26ed-c49a-44f4-95c8-7daf9b19435e: rpc.has_security_group_logging(os_id): False [ 821.748945] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.749355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.750476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.751115] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.751342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.751524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.752164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.752164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.752164] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 is going to be updated. [ 821.754465] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.754465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.754465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.754704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.755878] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2880f64-bee4-45fb-88ef-a60ad0c676d2: rpc.has_security_group_logging(os_id): False [ 821.766193] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afc090b2-bc85-4f97-aa84-42fe4b3085b7: rpc.has_security_group_logging(os_id): False [ 821.768366] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.768496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.768769] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24634bde-1ed8-4d4f-9db6-b19816b628d7: rpc.has_security_group_logging(os_id): False [ 821.769563] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6661d9a-0a2f-4ad7-a804-9e5004aa95db: rpc.has_security_group_logging(os_id): False [ 821.771161] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.771285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.772337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.772441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.773214] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55eb5d3-a252-4f36-9046-1505d8f8fa4e: rpc.has_security_group_logging(os_id): False [ 821.776153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.776463] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.776562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.776706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.777018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.777126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.777224] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 is going to be updated. [ 821.778197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.778380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.792526] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.792778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.799251] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.799451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.800189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.800338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.801314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.801429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.804925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.805337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.805564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.805564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.805759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.805861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.805961] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 821.807194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.807316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.834139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.834460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.834676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.834742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.834957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.835053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.835285] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.835421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.835489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.835676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.835757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.835966] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.836068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.836131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.836275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.836350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.836444] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be updated. [ 821.837833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.837997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.858850] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.859018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.860044] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.860151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.865772] env[65162]: INFO networking_nsxv3.common.synchronization [req-7e7e2605-8744-47b2-835d-7e59bb62af81 req-451848bc-c0ac-4527-88aa-6ed1ff5ea89e service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 821.865974] env[65162]: INFO networking_nsxv3.common.synchronization [req-7e7e2605-8744-47b2-835d-7e59bb62af81 req-451848bc-c0ac-4527-88aa-6ed1ff5ea89e service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 821.866124] env[65162]: INFO networking_nsxv3.common.synchronization [req-7e7e2605-8744-47b2-835d-7e59bb62af81 req-451848bc-c0ac-4527-88aa-6ed1ff5ea89e service nova] Enqueued Resource ID: 6ce0b48d-bdae-4783-8f4b-44c7dfb27090 with Priority: HIGHEST for action port [ 821.866653] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 821.866794] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 821.866893] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce0b48d-bdae-4783-8f4b-44c7dfb27090 with Priority: HIGHEST for action port [ 821.867170] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.867287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.867354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.867613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.867712] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.868601] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.869221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.869298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.873024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.873024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.873024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.873024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.873024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ce0b48d-bdae-4783-8f4b-44c7dfb27090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.880527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.880839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.880987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.881039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.881226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.881305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.881398] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 821.882572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.882845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.924585] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.924585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.949836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.950257] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.950368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.950434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.950678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.950815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.950958] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be updated. [ 821.954523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.954747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.993900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.994142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.994329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.994418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.994683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.994780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.994983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.995099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.995197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.995488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.995488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.995602] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.995683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.995738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.996097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.996349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.996349] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 821.997348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.997514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.024177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.024398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.048789] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.049361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.049729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.049729] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be updated. [ 822.057364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.058028] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.058028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.058028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.058028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.058266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.058266] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.058367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.058449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.058684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.058759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.058942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.061069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.061188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.061354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.061438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.061551] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 822.062667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.063279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.063376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.068467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.070026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.102696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: IN_PROGRESS for 2s [ 822.114387] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.114601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.120962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.121390] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.121623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.121731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.122096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.122218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.122471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.122596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.122675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.122865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.123219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.123599] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.123767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.123879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.124063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.124171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.124346] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be updated. [ 822.126013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.126222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.144056] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.144261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.144351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.144667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.144835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.165093] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.165093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.185454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.185454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.199375] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: IN_PROGRESS for 2s [ 822.213386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.215657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.215657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.215657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.215657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.216170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.216170] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be updated. [ 822.217653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.217653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.217653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.218722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.218722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.218722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.223021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.223021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.223021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.223021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.223021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.223021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.223409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.223647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.223816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.225245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.226129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.226129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.258027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.258027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.258027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.258027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.258027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.282118] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: IN_PROGRESS for 2s [ 822.283045] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 822.294210] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 822.296107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 822.313168] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 822.358424] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.358753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.358864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.359170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.359409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.376033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.376033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.376033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ce0b48d-bdae-4783-8f4b-44c7dfb27090 with status ACTIVE [ 822.376033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.376033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.376033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.377015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.377015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.377015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.377015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.377015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.377015] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ce0b48d-bdae-4783-8f4b-44c7dfb27090 is going to be updated. [ 822.390598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 822.400764] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 822.401864] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 822.430069] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.430264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.430356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.430582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.430734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.430954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ce0b48d-bdae-4783-8f4b-44c7dfb27090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.435564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.435564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.435564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.435564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.435990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.561834] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 822.779616] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 822.779616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.882661] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.385448] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.385725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.385791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.386077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.386267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.386321] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be created. [ 823.420250] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.420414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.420486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.420766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.421128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.434184] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: UNINITIALIZED for 2s [ 824.119652] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: SUCCESS [ 824.119652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.210529] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 824.210529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.310280] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 824.310517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.311309] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: SUCCESS [ 824.311514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.319517] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 824.319708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.321833] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 824.322090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.343615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 824.343615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.407317] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 824.408494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.420132] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 824.423440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.423440] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 824.423440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.581855] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 824.581855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.176829] env[65162]: INFO networking_nsxv3.common.synchronization [req-21702cbf-85f5-4041-b10e-ebd645ab9258 req-c44c16e2-f250-4a01-80b8-adaf3fb831f2 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_members [ 825.178594] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_members [ 825.179147] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.179413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.179589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.179934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.180304] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.181867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.181867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.181867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.181867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.181867] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.445926] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 825.445926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.445926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.446169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.446513] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.446513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.446672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.446774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.447780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.447780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.447780] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.579232] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.579232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.579232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.579232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.579724] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.579891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.580016] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.580231] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.580394] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.580580] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.580688] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.580794] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.580951] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.581035] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.581113] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.581225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.601706] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.601929] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 825.602130] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.602523] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.602743] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-95526c28-c283-4e55-810c-fbde82db8930 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.602931] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.603068] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.603589] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.603589] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95526c28-c283-4e55-810c-fbde82db8930',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.683680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.684098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.684098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.684240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.684240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.684425] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.684524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.684584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.684763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.684947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.685029] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb already deleted. [ 825.685106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.858172] env[65162]: INFO networking_nsxv3.common.synchronization [None req-08f68b21-945d-4968-984d-d39acd214411 None None] Enqueued Resource ID: d4a810d4-c45d-489e-a9bd-c150bc6931fe with Priority: HIGHEST for action port [ 825.859367] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4a810d4-c45d-489e-a9bd-c150bc6931fe with Priority: HIGHEST for action port [ 825.859511] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4a810d4-c45d-489e-a9bd-c150bc6931fe taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.862137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4a810d4-c45d-489e-a9bd-c150bc6931fe" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.862137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4a810d4-c45d-489e-a9bd-c150bc6931fe" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.862137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4a810d4-c45d-489e-a9bd-c150bc6931fe" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.862137] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4a810d4-c45d-489e-a9bd-c150bc6931fe',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.949528] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.949718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.949827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.950081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.950285] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.950658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.950744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.950954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.951086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.951208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.951398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.951792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.951862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.952052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.952227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.952331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.952405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.952572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.952924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.953045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.953160] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.109026] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.109026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 95526c28-c283-4e55-810c-fbde82db8930 not found, creating... [ 826.109026] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.109026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.109579] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.109579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.109579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.109579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.109579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.109942] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 95526c28-c283-4e55-810c-fbde82db8930 is going to be created. [ 826.132536] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.132536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.132536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.132536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.132536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.132536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.363035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4a810d4-c45d-489e-a9bd-c150bc6931fe [ 826.363597] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.363597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.363597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.363839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.363920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.364030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4a810d4-c45d-489e-a9bd-c150bc6931fe already deleted. [ 826.364149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4a810d4-c45d-489e-a9bd-c150bc6931fe" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.457499] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 826.479572] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.479863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.479863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.479994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.480090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.480269] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.480386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.480445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.480635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.480699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.481369] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.481369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.481369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.481369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.481369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.482756] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.482756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.482756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.482756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.482756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.482756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be created. [ 826.548318] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.548318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.548318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.548318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.560109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 826.846712] env[65162]: INFO networking_nsxv3.common.synchronization [req-21702cbf-85f5-4041-b10e-ebd645ab9258 req-15f25378-06bc-4e0f-8b84-bc29315bbe44 service nova] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_rules [ 826.846897] env[65162]: INFO networking_nsxv3.common.synchronization [req-21702cbf-85f5-4041-b10e-ebd645ab9258 req-15f25378-06bc-4e0f-8b84-bc29315bbe44 service nova] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_members [ 826.847080] env[65162]: INFO networking_nsxv3.common.synchronization [req-21702cbf-85f5-4041-b10e-ebd645ab9258 req-15f25378-06bc-4e0f-8b84-bc29315bbe44 service nova] Enqueued Resource ID: 95526c28-c283-4e55-810c-fbde82db8930 with Priority: HIGHEST for action port [ 826.847662] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_rules [ 826.847996] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_members [ 826.847996] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95526c28-c283-4e55-810c-fbde82db8930 with Priority: HIGHEST for action port [ 826.848894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.848894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.848894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.849108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.849286] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.850485] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.850604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.850673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.850850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.850997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.851108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.851184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.851335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.851424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.851514] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.853215] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-95526c28-c283-4e55-810c-fbde82db8930 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.853339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.853380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.854036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.854036] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95526c28-c283-4e55-810c-fbde82db8930',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.355662] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.355867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.356114] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.358847] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95526c28-c283-4e55-810c-fbde82db8930 with status ACTIVE [ 827.359066] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.359191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.359258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.359467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.359600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.359728] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.360162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.360162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.360162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.360162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.360312] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.360376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.360408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.362034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.362034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.362034] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95526c28-c283-4e55-810c-fbde82db8930 is going to be updated. [ 827.386142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.386428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.386428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.386641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.386778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.387012] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95526c28-c283-4e55-810c-fbde82db8930" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.862395] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.877592] env[65162]: INFO networking_nsxv3.common.synchronization [req-e5028098-3c19-4aa5-950b-77dde0eb05fa req-f6fe2aa3-3092-4e70-a273-27ba9a87c956 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 827.878159] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 827.878454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.878591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.878659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.879414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.879414] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.879414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.879414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.879839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.879839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.879839] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.273168] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.273393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.273517] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.274062] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.276337] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.276442] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.276567] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.276837] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.277017] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.277254] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.277350] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.277460] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.277561] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.277662] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.277777] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.277912] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.311187] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.311187] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.311187] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.311187] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.311187] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-2141caaa-4efc-40b4-be40-d42dcb5107aa taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.311814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.311814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.311814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.311814] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2141caaa-4efc-40b4-be40-d42dcb5107aa',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.367173] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.367574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.367574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.367875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.368031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.368180] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb is going to be created. [ 828.385161] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.385370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.385448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.385662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.385754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.385948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.386057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.386122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.386332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.386562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.386562] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 already deleted. [ 828.386687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.407934] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.408191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.408348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.408657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.409872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.425306] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb in Status: UNINITIALIZED for 2s [ 828.574130] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 828.574130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.814892] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.815385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.815627] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.815990] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.817686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.817686] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 2141caaa-4efc-40b4-be40-d42dcb5107aa not found, creating... [ 828.817686] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.817686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.817686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.817686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.817686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.818574] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.818963] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.819210] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.819509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.819761] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.822210] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa is going to be created. [ 828.847037] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.847037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.847037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.847037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.847037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.847037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.435058] env[65162]: INFO networking_nsxv3.common.synchronization [None req-02c7f577-79b3-4e11-b48e-828f8561b4f1 None None] Enqueued Resource ID: 47fc0777-2878-4689-84b9-1bedf6e48875 with Priority: HIGHEST for action port [ 829.438510] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47fc0777-2878-4689-84b9-1bedf6e48875 with Priority: HIGHEST for action port [ 829.438948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-47fc0777-2878-4689-84b9-1bedf6e48875 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.439148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47fc0777-2878-4689-84b9-1bedf6e48875" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.439309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47fc0777-2878-4689-84b9-1bedf6e48875" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.439495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47fc0777-2878-4689-84b9-1bedf6e48875" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.440074] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47fc0777-2878-4689-84b9-1bedf6e48875',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.665994] env[65162]: INFO networking_nsxv3.common.synchronization [req-e5028098-3c19-4aa5-950b-77dde0eb05fa req-c58f01f5-e1e0-4cd0-9161-235b02b29f6d service nova] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 829.666258] env[65162]: INFO networking_nsxv3.common.synchronization [req-e5028098-3c19-4aa5-950b-77dde0eb05fa req-c58f01f5-e1e0-4cd0-9161-235b02b29f6d service nova] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 829.666433] env[65162]: INFO networking_nsxv3.common.synchronization [req-e5028098-3c19-4aa5-950b-77dde0eb05fa req-c58f01f5-e1e0-4cd0-9161-235b02b29f6d service nova] Enqueued Resource ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa with Priority: HIGHEST for action port [ 829.666981] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 829.667289] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 829.667432] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa with Priority: HIGHEST for action port [ 829.667697] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.667871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.667992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.668178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.668250] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.669118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.669260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.669325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.669583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.669583] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.669743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.669743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.669883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.671477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.671477] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.675039] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2141caaa-4efc-40b4-be40-d42dcb5107aa taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.675039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.675039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.675039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.675039] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2141caaa-4efc-40b4-be40-d42dcb5107aa',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.945170] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47fc0777-2878-4689-84b9-1bedf6e48875 [ 829.945170] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.945305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.945348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.945566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.945672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.945773] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47fc0777-2878-4689-84b9-1bedf6e48875 already deleted. [ 829.945856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47fc0777-2878-4689-84b9-1bedf6e48875" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.176285] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.176534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.176604] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.178071] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2141caaa-4efc-40b4-be40-d42dcb5107aa with status ACTIVE [ 830.178235] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.178353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.178418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.178659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.178756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.179144] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.179255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.179363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.179467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.179545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.179734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.179824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.179885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.180119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.180119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.180222] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa is going to be updated. [ 830.213837] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.214040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.214040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.215034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.215034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.215034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.435833] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb in Status: SUCCESS [ 830.436953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.436953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.436953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.436953] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.436953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.436953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.437273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.437273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.437273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.437273] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.682573] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.941403] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.186372] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.186518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.186595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.186824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.187018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.187018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be created. [ 831.213697] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.213697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.213697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.213904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.213904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.224461] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: UNINITIALIZED for 2s [ 831.445337] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb: rpc.has_security_group_logging(os_id): False [ 831.464825] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.464986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.465087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.465267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.465352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.465597] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.465709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.465767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.465896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.465966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.466064] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb is going to be created. [ 831.528844] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.528989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.529078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.529290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.529472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.543618] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb in Status: IN_PROGRESS for 2s [ 832.899200] env[65162]: INFO networking_nsxv3.common.synchronization [req-e665a646-42b4-47eb-bda0-30fa86a1da5f req-03ff89b1-9cba-4d19-8d5f-9709e176a9b6 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 832.899777] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 832.900971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.900971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.900971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.901205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.901205] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.902909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.902909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.902909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.902909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.902909] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.236178] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 833.236328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.236440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.236627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.236937] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.237136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.237231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.237405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.237476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.237573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.237659] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.274850] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.275089] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.275225] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.275502] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.275791] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.275955] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.276727] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.276727] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.276727] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.276727] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.276872] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.276914] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.277030] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.277225] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.277225] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.277346] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.299434] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.299624] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.300380] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.300380] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.300380] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-1d72e1c7-7988-43bf-b624-0560ef576e66 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.300635] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.300860] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.301248] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.302144] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d72e1c7-7988-43bf-b624-0560ef576e66',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.404803] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.405778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.405778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.405961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.406174] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.406540] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.406658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.406658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.406872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.407060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.407299] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be deleted. [ 833.448394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.448394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.448394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.448394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.448394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.448394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.557800] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb in Status: SUCCESS [ 833.557800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.740568] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.740721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.740916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.742472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.742716] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.742843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.742913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.743126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.743202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.743297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.743460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.743553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.743614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.743760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.743894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.743982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.744054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.744202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.744276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.744361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.744464] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.804122] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.804393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.804486] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.804843] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.805060] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.805175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 1d72e1c7-7988-43bf-b624-0560ef576e66 not found, creating... [ 833.805498] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.805604] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.805688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.806101] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.806101] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.806323] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.806476] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.806586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.806820] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.806981] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.807110] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 1d72e1c7-7988-43bf-b624-0560ef576e66 is going to be created. [ 833.830344] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.830538] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.830669] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.830942] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.831301] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.831525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.246665] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9750e22b-5fab-447f-83f8-693fd5c74e09: rpc.has_security_group_logging(os_id): False [ 834.269558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.269824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.269961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.270187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.270303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.270587] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.270702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.270778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.270942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.271052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.271240] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.271430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.271430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.271572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.271940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.272147] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.272267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.272333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.272475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.272577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.272676] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be created. [ 834.363632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.363632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.363632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.363632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.363838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.380090] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 834.590222] env[65162]: INFO networking_nsxv3.common.synchronization [req-e665a646-42b4-47eb-bda0-30fa86a1da5f req-9ae1b596-f884-46fb-9f45-bb9a4589dc21 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 834.590452] env[65162]: INFO networking_nsxv3.common.synchronization [req-e665a646-42b4-47eb-bda0-30fa86a1da5f req-9ae1b596-f884-46fb-9f45-bb9a4589dc21 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 834.590607] env[65162]: INFO networking_nsxv3.common.synchronization [req-e665a646-42b4-47eb-bda0-30fa86a1da5f req-9ae1b596-f884-46fb-9f45-bb9a4589dc21 service nova] Enqueued Resource ID: 1d72e1c7-7988-43bf-b624-0560ef576e66 with Priority: HIGHEST for action port [ 834.591428] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 834.591635] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 834.591708] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d72e1c7-7988-43bf-b624-0560ef576e66 with Priority: HIGHEST for action port [ 834.591993] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.592107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.592175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.592368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.592450] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.593701] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.593818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.593938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.594078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.594246] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.594397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.594397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.594540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.594599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.594866] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.596855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d72e1c7-7988-43bf-b624-0560ef576e66 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.596855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.596855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.596855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.596855] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d72e1c7-7988-43bf-b624-0560ef576e66',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.098451] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.098451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.103027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d72e1c7-7988-43bf-b624-0560ef576e66 with status ACTIVE [ 835.103027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.103027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.103027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.103027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.103027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d72e1c7-7988-43bf-b624-0560ef576e66 is going to be updated. [ 835.104884] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.129047] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.129934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.129934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.129934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.129934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.129934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d72e1c7-7988-43bf-b624-0560ef576e66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.610424] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.116044] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.116044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.116044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.116257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.116257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.116339] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be created. [ 836.141920] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.141920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.142256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.142256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.142360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.153119] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: UNINITIALIZED for 2s [ 836.403506] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 836.403719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.165252] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 838.165624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.165624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.165909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.166267] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.166267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.166392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.166479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.166562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.166648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.167616] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.669440] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.671972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.671972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.671972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.671972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.672867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.672867] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.876597] env[65162]: INFO networking_nsxv3.common.synchronization [req-e35811d7-9333-4c25-887f-a9b511033195 req-6fe5483f-4190-45e7-8aa9-6ce289aee304 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 838.877204] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 838.877507] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.877642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.877708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.877919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.878295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.878459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.878555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.878775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.878904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.879686] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.176173] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 542ab4ea-1934-47eb-b35d-a11a9e723c30: rpc.has_security_group_logging(os_id): False [ 839.198767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.199250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.199250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.199346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.199602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.200029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.200029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.200029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.200201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.200268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.200503] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.200625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.200691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.200874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.200982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.201212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.201315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.201638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.201638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.201733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.201879] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be created. [ 839.297220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.297494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.297494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.297906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.298335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.314671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 839.381617] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.884656] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.388490] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.389220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.389220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.389220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.389220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.389497] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 840.422486] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.422587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.422751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.423678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.423764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.436546] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 840.468162] env[65162]: INFO networking_nsxv3.common.synchronization [req-56cabd51-a9c3-402b-9e10-ca75808122f8 req-09ea64fe-2a9d-4030-880b-dfbef34487ed tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 840.468702] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 840.469095] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.469236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.469307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.469529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.469666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.469764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.469825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.469970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.470065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.470158] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.972758] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.972946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.973030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.973243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.973352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.973535] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.973641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.973700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.973849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.973926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.974025] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 841.002037] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.002189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.002258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.002460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.002648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.015218] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 841.158364] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.158364] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.158454] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.158585] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.158922] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.159467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.159467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.159467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.159467] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.159467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.159686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.159686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.159756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.159912] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.160854] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.160975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.161033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.161648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.161648] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.161648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.161648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.161841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.161841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.161912] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.226385] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_rules [ 841.226556] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.226686] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 841.226807] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.226932] env[65162]: INFO networking_nsxv3.common.synchronization [req-bb92b558-1877-4aca-b025-8699699df345 req-f0defdae-9773-4c85-a27a-4ee9fabdbc7f tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa with Priority: HIGHEST for action port [ 841.228047] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_rules [ 841.228047] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 841.228047] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa with Priority: HIGHEST for action port [ 841.228206] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.228206] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.228427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.228549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.228614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.228867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.228953] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.229959] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.229959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.230139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.230217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.230294] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.231057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2141caaa-4efc-40b4-be40-d42dcb5107aa taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.231163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.231227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.231386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.231458] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2141caaa-4efc-40b4-be40-d42dcb5107aa',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.232172] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.232263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.232474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.232527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.329306] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 841.329306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.664359] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.666238] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.685689] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.685908] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_members [ 841.686046] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.686568] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.686666] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_members [ 841.686753] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.687265] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.687265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.687457] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fc90dd-4523-40bd-978d-d9bf1437468c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.687709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.687709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.687854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.687998] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.688138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.688200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.688433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.688433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.688551] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.689631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.689699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.734064] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.734212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.734408] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.734501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.735651] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2141caaa-4efc-40b4-be40-d42dcb5107aa with status ACTIVE [ 841.735848] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.735963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.736042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.736252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.736339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.736508] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.736602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.736663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.736808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.736885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.737203] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.737320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.737381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.737539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.737613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.737698] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa is going to be updated. [ 841.739529] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_rules [ 841.739689] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.739824] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_rules [ 841.739944] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_members [ 841.740095] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 841.740193] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.740309] env[65162]: INFO networking_nsxv3.common.synchronization [req-fee0cb4e-42e7-429d-b020-24132bd16579 req-f40ebe5a-50d1-45da-be01-438531417a07 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa with Priority: HIGHEST for action port [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_rules [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_rules [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa with Priority: HIGHEST for action port [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 841.741490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_members [ 841.745359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.745359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57fc90dd-4523-40bd-978d-d9bf1437468c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.745359] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.745359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.745359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2141caaa-4efc-40b4-be40-d42dcb5107aa taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.745359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.745359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.748516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.748624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.748840] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fc90dd-4523-40bd-978d-d9bf1437468c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.748920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.766262] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.766450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.766538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.766736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.766883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.767061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.767224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.767392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.767478] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2141caaa-4efc-40b4-be40-d42dcb5107aa',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.168504] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.169837] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.191125] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.245698] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fc90dd-4523-40bd-978d-d9bf1437468c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.245935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.274855] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2141caaa-4efc-40b4-be40-d42dcb5107aa with status ACTIVE [ 842.274855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.274855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.274855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.274855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.274855] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2141caaa-4efc-40b4-be40-d42dcb5107aa is going to be updated. [ 842.303730] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.303730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.303730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.303730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.303730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.303730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2141caaa-4efc-40b4-be40-d42dcb5107aa" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.446391] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 842.446616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.671444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.671815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.671815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.671815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.672046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.672046] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 842.673347] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.673497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.673540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.673706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.674338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.674338] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be created. [ 842.693659] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.711295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.711458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.711528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.711751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.711958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.720641] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.720809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.720880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.721057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.721236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.724919] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: UNINITIALIZED for 2s [ 842.730373] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 843.026969] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 843.027271] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 843.027271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.033791] env[65162]: INFO networking_nsxv3.common.synchronization [req-23a2179d-1324-4a8a-a177-ba983b6c4ff2 req-57e9367b-3c11-4d6d-8401-fb67f83f572c tempest-FloatingIPsAssociationNegativeTestJSON-523380269 tempest-FloatingIPsAssociationNegativeTestJSON-523380269-project-member] Enqueued Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_members [ 843.033791] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_members [ 843.034087] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.034204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.034270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.034530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.034908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.034908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.034908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.035097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.035184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.035283] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.197587] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.197873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.197991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.198233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.198325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.198434] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fc90dd-4523-40bd-978d-d9bf1437468c is going to be created. [ 843.226056] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.226614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.226614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.226771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.226937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.238336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: UNINITIALIZED for 2s [ 843.368552] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.368728] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-84" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.369212] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-84" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.369405] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-84" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.369603] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.369757] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.369879] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.370143] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.370299] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.370514] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.370625] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.370729] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.370836] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.371046] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.371152] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.371279] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.390111] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.390388] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.390471] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.390596] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-84" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.390903] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.391177] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.391306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.391621] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.391758] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.538156] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.538336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.538493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.538666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.538776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.538976] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.539122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.539171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.539296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.539387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.539454] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8402ae4d-ae29-4339-9c47-47671f8a297d already deleted. [ 843.539533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.895603] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.895929] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.896034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.896315] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.896608] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.896608] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a not found, creating... [ 843.896852] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.897023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.897283] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.897541] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.897682] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.897977] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.898180] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.898294] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.898495] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.898621] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.898756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a is going to be created. [ 843.920025] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.920242] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.920372] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.920654] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.920884] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.921324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.669642] env[65162]: INFO networking_nsxv3.common.synchronization [req-23a2179d-1324-4a8a-a177-ba983b6c4ff2 req-550f0c98-938d-4419-b92d-8e163d0d700e service nova] Enqueued Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_rules [ 844.670044] env[65162]: INFO networking_nsxv3.common.synchronization [req-23a2179d-1324-4a8a-a177-ba983b6c4ff2 req-550f0c98-938d-4419-b92d-8e163d0d700e service nova] Enqueued Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_members [ 844.670278] env[65162]: INFO networking_nsxv3.common.synchronization [req-23a2179d-1324-4a8a-a177-ba983b6c4ff2 req-550f0c98-938d-4419-b92d-8e163d0d700e service nova] Enqueued Resource ID: ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a with Priority: HIGHEST for action port [ 844.671190] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_rules [ 844.671490] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_members [ 844.671682] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a with Priority: HIGHEST for action port [ 844.672118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.672316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.672431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.673410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.673410] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.675096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.675909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.675909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.675909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.675909] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.676250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.676250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.676487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.676647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.676802] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.677939] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.678131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.678249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.678549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.678648] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.736326] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 844.736627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.736794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.737025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.737212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.737393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.737457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.737626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.737710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.738219] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.739409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 844.739581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.739748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.739922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.740994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.741308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.741400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.741574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.741660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.741754] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.183444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.183444] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.183444] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a with status ACTIVE [ 845.183444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.183444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.183444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.186798] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.186798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.186798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.186798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.186798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.186798] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a is going to be updated. [ 845.207635] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.207916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.207984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.208424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.208424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.208621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab43dcf1-fd6f-44e0-b4c0-eac9bc7b1e5a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.243640] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.244606] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.250263] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: SUCCESS [ 845.250263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.250402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.250522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.251141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.251141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.251141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.251141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.251141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.251354] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.686855] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.740733] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5c67e86-a3fc-49a2-b111-68151f5c60c4 req-27c64282-f304-4207-a4d1-8f8b65b58bca tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 845.741602] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 845.742105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.742282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.742399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.742782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.742960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.743124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.743219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.743448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.743573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.743715] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.746982] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.747712] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.753290] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.081924] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.081924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.081924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.081924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.082218] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.082684] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.082883] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.083127] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.083277] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.083510] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.083637] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.083744] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.083848] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.083971] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.084094] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.084241] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.104453] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.104623] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.104850] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.105060] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.105423] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-063e712a-8d0b-4ad3-9aac-05b32da522db taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.105540] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.105899] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.106038] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.106154] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063e712a-8d0b-4ad3-9aac-05b32da522db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.189378] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.189700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.189700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.189805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.189892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.189991] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8402ae4d-ae29-4339-9c47-47671f8a297d is going to be created. [ 846.214123] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.214282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.214377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.214556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.214719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.225274] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8402ae4d-ae29-4339-9c47-47671f8a297d in Status: UNINITIALIZED for 2s [ 846.246983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.247213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.247298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.247514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.247603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.247807] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.247904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.248013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.248118] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.248193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.248276] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d already deleted. [ 846.248354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.249774] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.249881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.249932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.250089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.250168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.250291] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 846.251969] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.252081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.252136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.252289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.252370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.252458] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be updated. [ 846.254947] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.288088] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.288088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.288088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.288287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.288364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.304620] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: IN_PROGRESS for 2s [ 846.310824] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.310963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.311045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.311252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.311392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.325136] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 846.608817] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.609081] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.609081] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.609321] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.609477] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.609608] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 063e712a-8d0b-4ad3-9aac-05b32da522db not found, creating... [ 846.609869] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.610043] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.610160] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.610376] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.610512] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.610849] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.610969] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.611071] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.611283] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.611416] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.611550] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 063e712a-8d0b-4ad3-9aac-05b32da522db is going to be created. [ 846.631509] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.631679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.631762] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.632057] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.632290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.632568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.757423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.757637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.757637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.757864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.757954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.758070] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fc90dd-4523-40bd-978d-d9bf1437468c is going to be updated. [ 846.814648] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.814736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.814736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.814998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.815159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.826051] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: IN_PROGRESS for 2s [ 847.384464] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5c67e86-a3fc-49a2-b111-68151f5c60c4 req-f1a36d88-55cd-41dd-b3e7-4dadc7c364b7 service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 847.384464] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5c67e86-a3fc-49a2-b111-68151f5c60c4 req-f1a36d88-55cd-41dd-b3e7-4dadc7c364b7 service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 847.384464] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5c67e86-a3fc-49a2-b111-68151f5c60c4 req-f1a36d88-55cd-41dd-b3e7-4dadc7c364b7 service nova] Enqueued Resource ID: 063e712a-8d0b-4ad3-9aac-05b32da522db with Priority: HIGHEST for action port [ 847.384853] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 847.384853] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 847.384853] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063e712a-8d0b-4ad3-9aac-05b32da522db with Priority: HIGHEST for action port [ 847.385174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.385294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.385363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.385789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.385789] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.386631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.389346] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.389346] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.389346] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-063e712a-8d0b-4ad3-9aac-05b32da522db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.389346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.389346] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063e712a-8d0b-4ad3-9aac-05b32da522db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.890430] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.893671] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.893671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 063e712a-8d0b-4ad3-9aac-05b32da522db with status ACTIVE [ 847.893671] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.893671] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.893671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.894111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.894414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.896634] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.896634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.896634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.896634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.896634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.896634] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 063e712a-8d0b-4ad3-9aac-05b32da522db is going to be updated. [ 847.925802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.925974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.926058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.926286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.926446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.926603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-063e712a-8d0b-4ad3-9aac-05b32da522db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.235214] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8402ae4d-ae29-4339-9c47-47671f8a297d in Status: SUCCESS [ 848.235622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.235622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.236133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.236133] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.236307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.236307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.236602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.236602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.236704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.236739] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.315764] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 848.315910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.316582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.316889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.317153] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.317385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.317461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.317679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.317940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.317940] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.333747] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 848.333956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.334175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.334434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.334621] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.334735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.334870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.335066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.335148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.335261] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.369295] env[65162]: INFO networking_nsxv3.common.synchronization [req-bf78a7a4-8ac3-453d-93ee-6283d83be54b req-eb9bc297-238a-4f95-8497-36d8e25c61f2 tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 848.371457] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 848.371942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.372145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.372249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.372545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.372764] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.372858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.373422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.373422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.373422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.373422] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.398938] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.741049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.741049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.741049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.741049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.741796] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.741796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.741796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.741796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.741796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.741994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.741994] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.820717] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.837028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: SUCCESS [ 848.837028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.837028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.837028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.837266] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.837266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.837359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.837463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.837524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.837725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.837725] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.838977] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.876240] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.876413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.876464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.876668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.876749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.876931] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.877032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.877091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.877233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.879212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.879212] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be deleted. [ 848.901054] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.902067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.902067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.902067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.902067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.902067] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be created. [ 848.918132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.918345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.919906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.919906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.919906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.920793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.931772] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.931993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.931993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.932392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.932392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.938799] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-369 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.939080] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.939205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.939445] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.939759] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.939916] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.940060] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.940281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.940432] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.940638] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.940745] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.940849] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.940952] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.941066] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.941168] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.941293] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.947023] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: UNINITIALIZED for 2s [ 848.968844] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.968844] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.968844] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.968844] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-369" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.970038] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.970259] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.970380] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.970696] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.970835] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10cadf40-6e67-4ee2-97a0-a66ef51fe52a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.248794] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8402ae4d-ae29-4339-9c47-47671f8a297d: rpc.has_security_group_logging(os_id): False [ 849.268387] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.268924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.269058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.269285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.269404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.269632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.269841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.269978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.270192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.270302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.270516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.270712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.270801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.271053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.271165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.271436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.271597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.271669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.271818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.271901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.271990] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8402ae4d-ae29-4339-9c47-47671f8a297d is going to be created. [ 849.323058] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.340266] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.341435] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.385167] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.385167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.385167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.385460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.385460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.401133] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8402ae4d-ae29-4339-9c47-47671f8a297d in Status: IN_PROGRESS for 2s [ 849.474243] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.474671] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.474836] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.475172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.475406] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.475555] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 10cadf40-6e67-4ee2-97a0-a66ef51fe52a not found, creating... [ 849.475780] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.475974] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.476103] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.476350] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.476518] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.476831] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.476988] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.477114] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.477333] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.477466] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.477610] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 10cadf40-6e67-4ee2-97a0-a66ef51fe52a is going to be created. [ 849.504897] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.505188] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.505314] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.505641] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.505921] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.506191] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.826811] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.827010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.827091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.827434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.827580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.827687] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be updated. [ 849.844101] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57fc90dd-4523-40bd-978d-d9bf1437468c: rpc.has_security_group_logging(os_id): False [ 849.846103] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.846353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.846470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.846772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.847190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.847190] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 849.875741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.875993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.876090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.876347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.876481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.876731] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.876874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.876936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.877195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.877313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.877368] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57fc90dd-4523-40bd-978d-d9bf1437468c is going to be created. [ 849.885317] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.885619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.885619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.885867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.885980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.898235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: IN_PROGRESS for 2s [ 849.902109] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.902362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.902362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.902531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.902691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.915825] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 849.954494] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.954494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.954494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.954494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.954494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.973486] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: IN_PROGRESS for 2s [ 850.273377] env[65162]: INFO networking_nsxv3.common.synchronization [req-bf78a7a4-8ac3-453d-93ee-6283d83be54b req-83295d0d-d21a-485e-b391-813b79589848 service nova] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_rules [ 850.273732] env[65162]: INFO networking_nsxv3.common.synchronization [req-bf78a7a4-8ac3-453d-93ee-6283d83be54b req-83295d0d-d21a-485e-b391-813b79589848 service nova] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 850.273903] env[65162]: INFO networking_nsxv3.common.synchronization [req-bf78a7a4-8ac3-453d-93ee-6283d83be54b req-83295d0d-d21a-485e-b391-813b79589848 service nova] Enqueued Resource ID: 10cadf40-6e67-4ee2-97a0-a66ef51fe52a with Priority: HIGHEST for action port [ 850.274728] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_rules [ 850.275076] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 850.275125] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10cadf40-6e67-4ee2-97a0-a66ef51fe52a with Priority: HIGHEST for action port [ 850.275521] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.275713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.275834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.276115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.276236] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.277571] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.277738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.278703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.278935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.279154] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.279261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.279327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.279521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.279600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.280969] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.282486] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.282627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.282627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.282857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.282966] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10cadf40-6e67-4ee2-97a0-a66ef51fe52a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.786181] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.787989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.787989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.787989] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10cadf40-6e67-4ee2-97a0-a66ef51fe52a with status ACTIVE [ 850.787989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.787989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.788347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.788347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.788347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.788614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.788614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.788767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.788891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.789023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.789495] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.789495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.789495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.789897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.789897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.789897] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10cadf40-6e67-4ee2-97a0-a66ef51fe52a is going to be updated. [ 850.826972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.827189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.827189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.827434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.827581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.827835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10cadf40-6e67-4ee2-97a0-a66ef51fe52a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.960844] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 850.961078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.961253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.961472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.961665] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.961786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.962235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.962427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.963074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.963239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.963393] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.288801] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.414186] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8402ae4d-ae29-4339-9c47-47671f8a297d in Status: SUCCESS [ 851.414492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.467852] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.468248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.468547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.468842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.469959] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.470240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.470395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.470665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.473024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.473024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.473024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.473024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.797391] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.797391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.797391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.797391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.797391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.797391] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be created. [ 851.828764] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.830539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.830539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.830539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.830539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.842925] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: UNINITIALIZED for 2s [ 851.909994] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.913019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.913019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.913019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.914452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.915134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.916917] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.916917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.916917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.916917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.916917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.916917] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.932958] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 851.932958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.932958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.932958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.932958] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.932958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.934448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.934448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.934448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.934448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.934448] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.938018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.938018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.938753] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.938753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.938753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.939424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.939424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.939735] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.978291] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03c457f4-5193-48c8-99b4-9dd3e8a1a23d: rpc.has_security_group_logging(os_id): False [ 851.999157] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: SUCCESS [ 851.999557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.000624] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.002130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.002242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.002456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.002547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.002764] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.002890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.002958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.003191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.003307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.003521] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.006113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.006199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.006514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.006514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.006616] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.006713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.006775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.006917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.006990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.007089] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be created. [ 852.042209] env[65162]: INFO networking_nsxv3.common.synchronization [req-8e853283-5542-4d0f-9896-de06d68b5db6 req-5c26e493-9929-4c59-973b-0eba1b249cc8 tempest-ServersAdminNegativeTestJSON-1297608031 tempest-ServersAdminNegativeTestJSON-1297608031-project-member] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 852.042852] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGHEST for action security_group_members [ 852.044188] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.044377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.044483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.044755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.045514] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.045514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.045668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.045822] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.045964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.046130] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.072023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.072023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.072023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.072023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.072023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.083709] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 852.416110] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.421132] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.437856] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.437856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.443453] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.549197] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.549197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.549830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.549830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.549830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.550032] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.550113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.552055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.552055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.552055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.552055] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be updated. [ 852.580673] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.580869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.580930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.582201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.582201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.597050] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: IN_PROGRESS for 2s [ 852.918651] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f: rpc.has_security_group_logging(os_id): False [ 852.923033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.937337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.937337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.937337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.937536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.937536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.938347] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.938347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.938347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.938347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.938347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.938347] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be created. [ 852.945608] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.000101] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.000263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.000333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.000545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.000721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.013086] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: IN_PROGRESS for 2s [ 853.428615] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.428615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.428615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.428615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.428615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.428615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be updated. [ 853.448360] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.448627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.448682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.448929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.449099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.449099] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 853.463270] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.463484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.463592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.463908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.464142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.473273] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: IN_PROGRESS for 2s [ 853.492859] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.493161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.493380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.494244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.494894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.511914] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 853.853386] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 853.853951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.853951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.854216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.855042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.855042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.855042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.855042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.855042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.855042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.855042] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.978292] env[65162]: INFO networking_nsxv3.common.synchronization [None req-081af706-8741-4000-9ccf-ef4ce093d0b2 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_rules [ 853.979471] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_rules [ 853.979680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.980035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.980123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.981210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.981210] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.097695] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 854.097917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.131555] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b074d15b-add1-45b2-8e4d-64419b5247e6 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_rules [ 854.133081] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_rules [ 854.133081] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.133081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.357212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.357459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.357565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.357867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.358376] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.358566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.358666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.358943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.359100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.359204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.359413] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.359513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.359576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.359790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.360026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.360176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.360355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.360581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.360699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.360823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.360955] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.517874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.518109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.518308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.518505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.518886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.518886] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 already deleted. [ 854.518886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.519090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.519284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.519400] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.607913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d in Status: SUCCESS [ 854.608162] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d deletion is rescheduled due to dependency. [ 854.608246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.864708] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dd59e3c-797c-4664-8f76-fa18f1a811b1: rpc.has_security_group_logging(os_id): False [ 854.882569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.884566] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.884566] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.884566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.885737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.885737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.885737] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.885737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.885737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.885737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.885737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.885737] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be created. [ 854.947593] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.947593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.947593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.947799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.947963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.961825] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 855.033104] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 855.033397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.033397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.033882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.033882] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.046410] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.046597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.046688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.046956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.047084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.047513] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 already deleted. [ 855.047513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.485029] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 855.485029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.522929] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 855.523169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.523345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.523577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.523795] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.523918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.524119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.524449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.524449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.524449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.524565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.524609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.524670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.524818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.524983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.525335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.525460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.525653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.525883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.526147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.526147] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.537644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.538401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.538401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.538401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.539297] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.539297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.539297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.539297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.539297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.539297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.539297] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.030171] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9750e22b-5fab-447f-83f8-693fd5c74e09: rpc.has_security_group_logging(os_id): False [ 856.041639] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.051072] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.052907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.053061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.053314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.053580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.053674] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.053791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.053921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.054025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.054107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.054304] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.054400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.054895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.056409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.056516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.056757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.056757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.056860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.056983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.057039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.057134] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 856.128534] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.129429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.129429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.129429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.129429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.146437] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 856.167593] env[65162]: INFO networking_nsxv3.common.synchronization [req-76f0c43e-e646-4389-95db-4dd2cf707ff6 req-392738e8-d228-48de-9702-075523ab0e1f tempest-ListImageFiltersTestJSON-70258688 tempest-ListImageFiltersTestJSON-70258688-project-member] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 856.167593] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGHEST for action security_group_members [ 856.168137] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.168316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.168409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.168648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.168858] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.170195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.170350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.170484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.170580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.170685] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.544470] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f: rpc.has_security_group_logging(os_id): False [ 856.607023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.607115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.607115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.607423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.607540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.607821] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.607935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.608023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.608207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.608291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.608394] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be updated. [ 856.672875] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.672875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.672875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.673161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.691894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.692072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.699602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.700110] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.700110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.700110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.700679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.700679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.700679] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be updated. [ 856.701460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.701643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.701779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.740178] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: IN_PROGRESS for 2s [ 856.757679] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.757881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.757881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.758043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.758195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.768470] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: IN_PROGRESS for 2s [ 856.859843] env[65162]: INFO networking_nsxv3.common.synchronization [None req-78016a16-4b2c-4a51-bfa3-6a92b1cce92b None None] Enqueued Resource ID: 08772512-5b45-4504-86b5-908e05a14305 with Priority: HIGHEST for action port [ 856.860444] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08772512-5b45-4504-86b5-908e05a14305 with Priority: HIGHEST for action port [ 856.860749] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-08772512-5b45-4504-86b5-908e05a14305 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.861577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08772512-5b45-4504-86b5-908e05a14305" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.861666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08772512-5b45-4504-86b5-908e05a14305" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.861909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08772512-5b45-4504-86b5-908e05a14305" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.861995] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08772512-5b45-4504-86b5-908e05a14305',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.974235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 856.974449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.364746] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08772512-5b45-4504-86b5-908e05a14305 [ 857.365843] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.365843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.365843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.365843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.365843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.366192] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08772512-5b45-4504-86b5-908e05a14305 already deleted. [ 857.366192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08772512-5b45-4504-86b5-908e05a14305" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.162655] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 858.162655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.162655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.162655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.162655] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.455539] env[65162]: INFO networking_nsxv3.common.synchronization [req-917e41f3-e589-41e3-bb36-2f54b592f13d req-14533ae5-9c35-4f76-996d-ffb982ace02c tempest-ServerGroupTestJSON-1607907676 tempest-ServerGroupTestJSON-1607907676-project-member] Enqueued Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_members [ 858.455867] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_members [ 858.455909] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.456027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.458640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.458640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.458640] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.458640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.458640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.458640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.458640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.458640] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.665384] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.665619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.665698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.665981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.666148] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.666255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.666321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.666472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.666559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.666647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.666738] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.692074] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5f2e83ec-645c-4975-a2c4-ed408b69b629 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 858.692691] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 858.692874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.693932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.693932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.694379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.694379] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.754352] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 858.754352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.779510] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f in Status: SUCCESS [ 858.780095] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f deletion is rescheduled due to dependency. [ 858.780095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.876243] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.876504] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-681" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.876724] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-681" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.876840] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-681" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.877120] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.877280] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.877396] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.877604] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.877742] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.877947] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.878068] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.878173] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.878275] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.878404] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.878484] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.878611] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.899474] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.899474] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.899474] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.900132] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-681" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.900132] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-8f1e2d8e-0e92-4d56-80a8-787257ebe154 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.900132] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.900389] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.900506] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.900667] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1e2d8e-0e92-4d56-80a8-787257ebe154',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.903362] env[65162]: INFO networking_nsxv3.common.synchronization [None req-e2be59f3-bacd-4f2e-9697-ac214362378c tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 858.903789] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 858.904309] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.904433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.960842] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.961094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.961094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.961449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.961449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.961902] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.961902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.961902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.962315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.962315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.962315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8253b890-33c3-4c25-961c-e88cce1b8eff already deleted. [ 858.962315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.169147] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.169337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.169411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.169632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.169814] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.169919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.169983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.170154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.170240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.170328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.170473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.170562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.170623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.170760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.170894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.171014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.171077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.171204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.171269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.171347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.171437] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.232164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.232290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.232400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.232707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.233058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.233058] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 already deleted. [ 859.233236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.233328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.234127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.234448] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.404798] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.405065] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.405197] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.405766] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.405766] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.405908] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 8f1e2d8e-0e92-4d56-80a8-787257ebe154 not found, creating... [ 859.406098] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.406261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.406377] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.406623] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.406762] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.407226] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.407416] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.407534] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.407819] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.407982] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.408196] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 8f1e2d8e-0e92-4d56-80a8-787257ebe154 is going to be created. [ 859.430410] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.430636] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.430766] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.431093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.431306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.431530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.434490] env[65162]: INFO networking_nsxv3.common.synchronization [None req-3761ef5b-d7e9-42b0-81c7-40d629e70f93 None None] Enqueued Resource ID: 793b0df7-1371-45e7-a1a7-d59bfa984f37 with Priority: HIGHEST for action port [ 859.434752] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b0df7-1371-45e7-a1a7-d59bfa984f37 with Priority: HIGHEST for action port [ 859.435353] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-793b0df7-1371-45e7-a1a7-d59bfa984f37 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.435472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-793b0df7-1371-45e7-a1a7-d59bfa984f37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.435540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-793b0df7-1371-45e7-a1a7-d59bfa984f37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.435766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-793b0df7-1371-45e7-a1a7-d59bfa984f37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.435888] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793b0df7-1371-45e7-a1a7-d59bfa984f37',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.674763] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9750e22b-5fab-447f-83f8-693fd5c74e09: rpc.has_security_group_logging(os_id): False [ 859.697424] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.697707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.697765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.698017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.698125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.698386] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.698519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.698588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.698766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.698864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.699105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.699227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.699291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.699468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.699596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.699767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.699870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.699918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.700121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.700412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.700506] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 859.755268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.755268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.755268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.755268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.755268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.755268] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 already deleted. [ 859.755655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.760242] env[65162]: INFO networking_nsxv3.common.synchronization [req-2d3fee6d-6164-4ea9-a604-9c1bf0939cef req-5584becb-3365-42a5-adc2-100163626d93 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 859.760800] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 859.761117] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.761265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.761661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.761947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.762201] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.762465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.762543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.762795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.762863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.763028] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.765155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.765333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.765482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.765659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.765869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.781620] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 859.938294] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 793b0df7-1371-45e7-a1a7-d59bfa984f37 [ 859.939029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.939029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.939029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.939029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.939029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.939324] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:793b0df7-1371-45e7-a1a7-d59bfa984f37 already deleted. [ 859.939324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-793b0df7-1371-45e7-a1a7-d59bfa984f37" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.152250] env[65162]: INFO networking_nsxv3.common.synchronization [req-917e41f3-e589-41e3-bb36-2f54b592f13d req-97ad78ee-15f4-459e-b6ac-2640f7cbd041 service nova] Enqueued Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_rules [ 860.152423] env[65162]: INFO networking_nsxv3.common.synchronization [req-917e41f3-e589-41e3-bb36-2f54b592f13d req-97ad78ee-15f4-459e-b6ac-2640f7cbd041 service nova] Enqueued Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_members [ 860.152554] env[65162]: INFO networking_nsxv3.common.synchronization [req-917e41f3-e589-41e3-bb36-2f54b592f13d req-97ad78ee-15f4-459e-b6ac-2640f7cbd041 service nova] Enqueued Resource ID: 8f1e2d8e-0e92-4d56-80a8-787257ebe154 with Priority: HIGHEST for action port [ 860.153343] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_rules [ 860.153500] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_members [ 860.153645] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1e2d8e-0e92-4d56-80a8-787257ebe154 with Priority: HIGHEST for action port [ 860.153869] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.154196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.154196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.154376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.154607] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.155473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.155763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.155842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.156052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.156212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.156303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.156364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.156478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.156558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.156650] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.157401] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f1e2d8e-0e92-4d56-80a8-787257ebe154 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.157956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.157956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.157956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.158270] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1e2d8e-0e92-4d56-80a8-787257ebe154',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.180687] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd704d91-2d72-422d-b215-0b764ec68395 req-f5c55214-82e5-4a1d-8d71-c085efefac13 tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 860.181470] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 860.181693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.181819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.181888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.183024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.183225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.183366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.183440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.183625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.183716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.183816] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.268651] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.268811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.268883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.269119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.269215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.269415] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.269510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.269566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.269703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.269777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.269865] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 860.336425] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.336607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.336682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.336907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.337068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.348926] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 860.638949] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.639164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.639291] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.639558] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.639872] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.640222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.640348] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.640572] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.640716] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.640919] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.641053] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.641188] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.641295] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.641402] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.641503] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.641627] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.660201] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.660405] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.660526] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.660732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.661093] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.661281] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.661437] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.661801] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.661962] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.662927] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f1e2d8e-0e92-4d56-80a8-787257ebe154 with status ACTIVE [ 860.663141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.663261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.663340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.663534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.663656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.663838] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.664013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.664096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.664265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.664344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.664540] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.664644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.664718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.664860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.665012] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.665109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f1e2d8e-0e92-4d56-80a8-787257ebe154 is going to be updated. [ 860.666220] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.667142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.667250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.686917] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.687366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.687366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.687366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.687486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.687628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f1e2d8e-0e92-4d56-80a8-787257ebe154" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.687834] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.169516] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.170839] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.171055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.171229] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.171478] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.171686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.171897] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 not found, creating... [ 861.172179] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.172338] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.172595] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.172664] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.173166] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.173789] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.173966] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.174096] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.174311] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.175254] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.175254] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 is going to be created. [ 861.189533] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.199690] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.201994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.201994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.201994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.201994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.201994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.677139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.677320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.677437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.677600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.677687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.677790] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8253b890-33c3-4c25-961c-e88cce1b8eff is going to be created. [ 861.692867] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.693231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.693231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.693337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.693395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.693502] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 861.703668] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.703804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.703899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.704142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.704297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.713040] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8253b890-33c3-4c25-961c-e88cce1b8eff in Status: UNINITIALIZED for 2s [ 861.730464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.730464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.730464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.730464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.730464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.743758] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 861.800507] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 861.800507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.912977] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd704d91-2d72-422d-b215-0b764ec68395 req-b28ba44e-b46e-47ad-82ca-a672809e6496 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 861.913723] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd704d91-2d72-422d-b215-0b764ec68395 req-b28ba44e-b46e-47ad-82ca-a672809e6496 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 861.913723] env[65162]: INFO networking_nsxv3.common.synchronization [req-dd704d91-2d72-422d-b215-0b764ec68395 req-b28ba44e-b46e-47ad-82ca-a672809e6496 service nova] Enqueued Resource ID: 0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 with Priority: HIGHEST for action port [ 861.913974] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 861.914730] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 861.914777] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 with Priority: HIGHEST for action port [ 861.915082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.915317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.915317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.915476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.915574] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.916492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.916587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.917505] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.917505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.917505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.917505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.917505] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.360506] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 862.360757] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 862.360987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.421502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.421502] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 with status ACTIVE [ 862.421502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.421502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.421502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.421502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.422249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.422249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.422249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.422249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.422249] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70 is going to be updated. [ 862.448515] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.448717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.448799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.449112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.449313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.449557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab2eb61-1bad-44c0-aa6e-d5d2ee379a70" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.724875] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8253b890-33c3-4c25-961c-e88cce1b8eff in Status: SUCCESS [ 863.725298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.725298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.725384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.725662] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.725662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.726116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.726116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.726116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.726116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.726116] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.755288] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 863.755546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.756181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.756435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.756669] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.756847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.756922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.757128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.757236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.757355] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.231521] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.231677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.231743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.231962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.235111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.235111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.235111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.235111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.235111] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.260123] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.735705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8253b890-33c3-4c25-961c-e88cce1b8eff: rpc.has_security_group_logging(os_id): False [ 864.755972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.756217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.756217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.756410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.756494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.756796] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.756955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.757074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.757314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.757400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.757597] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.757695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.757756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.757894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.757967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.758507] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.758654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.758748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.759305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.759431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.759591] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8253b890-33c3-4c25-961c-e88cce1b8eff is going to be created. [ 864.761924] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.825521] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.825643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.825719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.826180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.826289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.843032] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8253b890-33c3-4c25-961c-e88cce1b8eff in Status: IN_PROGRESS for 2s [ 865.239938] env[65162]: INFO networking_nsxv3.common.synchronization [req-d233f162-3e9c-474e-975a-5f8f4da98c55 req-30e03210-7193-47f9-9ab3-bcab1e7670fa tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 865.240705] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 865.241214] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.241387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.241484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.241760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.241931] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.242104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.242176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.242401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.242502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.242654] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.265692] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.266091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.266091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.266395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.266444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.266543] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 865.317707] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.317882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.318020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.318175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.318378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.327472] env[65162]: INFO networking_nsxv3.common.synchronization [req-66be155f-84cb-4300-a91e-eee963f30049 req-126610ca-86c9-460c-a668-5d8c5bf592e8 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 865.328420] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 865.328838] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 865.331999] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.332184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.332259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.332462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.332668] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.332811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.332897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.333373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.333471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.333574] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.356651] env[65162]: INFO networking_nsxv3.common.synchronization [req-66be155f-84cb-4300-a91e-eee963f30049 req-126610ca-86c9-460c-a668-5d8c5bf592e8 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 865.356651] env[65162]: INFO networking_nsxv3.common.synchronization [req-66be155f-84cb-4300-a91e-eee963f30049 req-126610ca-86c9-460c-a668-5d8c5bf592e8 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 865.356651] env[65162]: INFO networking_nsxv3.common.synchronization [req-66be155f-84cb-4300-a91e-eee963f30049 req-126610ca-86c9-460c-a668-5d8c5bf592e8 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 31a6ff26-d421-451e-973d-bc991354e390 with Priority: HIGHEST for action port [ 865.356651] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 865.356651] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 865.356651] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a6ff26-d421-451e-973d-bc991354e390 with Priority: HIGHEST for action port [ 865.356651] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.356651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.356651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.357950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.357950] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.357950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.357950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.358313] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a6ff26-d421-451e-973d-bc991354e390 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.358313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.358313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.358460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.358497] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a6ff26-d421-451e-973d-bc991354e390',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.746086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.746556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.746556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.746700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.746962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.747204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.747371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.747510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.747768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.748034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.748129] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 865.760705] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.760894] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.761079] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.761360] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.761616] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.761791] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.761929] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.762127] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.762275] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.762489] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.762695] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.762904] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.762949] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.763106] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.763187] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.763323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.784405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.784614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.784614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.784912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.785122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.788441] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.788690] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.788783] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.789018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.789342] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.789522] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.789739] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.790018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.790188] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('727b5ad5-4d1f-4c71-8dd5-f833cda569e3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.796959] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 865.837476] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.860474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.860474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.860747] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31a6ff26-d421-451e-973d-bc991354e390 with status ACTIVE [ 865.860789] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.861376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.861376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.861376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.861376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.861606] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.861606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.861692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.862125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.862125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.862125] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.862267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.862267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.862361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.862565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.862565] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31a6ff26-d421-451e-973d-bc991354e390 is going to be updated. [ 865.886386] env[65162]: INFO networking_nsxv3.common.synchronization [req-b59a1aed-b5f5-4dd3-a926-8c381dd0f2a8 req-055375d0-47ee-45c2-a2ac-7b973e0b325f tempest-ImagesOneServerNegativeTestJSON-1501229009 tempest-ImagesOneServerNegativeTestJSON-1501229009-project-member] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 865.886834] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGHEST for action security_group_members [ 865.887282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.887474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.887474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.887702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.887894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.888015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.888104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.888316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.888425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.888550] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.892561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.892740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.892845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.893103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.893276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.893464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.292799] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.293190] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.293322] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.293635] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.293852] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.293999] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 727b5ad5-4d1f-4c71-8dd5-f833cda569e3 not found, creating... [ 866.294359] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294533] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294666] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.295018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.295184] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.295545] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.295681] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.295794] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.296110] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.296285] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.296426] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 727b5ad5-4d1f-4c71-8dd5-f833cda569e3 is going to be created. [ 866.322606] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.323646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.323646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.323646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.323646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.324046] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.341024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.391350] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.391979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.391979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.391979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.392383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.392745] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.392745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.392745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.393063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.393202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.393364] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be updated. [ 866.430743] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.430933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.430992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.431172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.431643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.446729] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: IN_PROGRESS for 2s [ 866.717645] env[65162]: INFO networking_nsxv3.common.synchronization [req-17a62c8f-389c-4281-9a55-ada985144193 req-fd490db3-1bc0-41c1-a05e-f74cb05f2962 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 866.718325] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 866.718650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.718786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.718881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.719308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.719472] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.719579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.719642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.719804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.719902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.719975] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.844444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.844777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.844777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.844865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.844906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.845131] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 866.861730] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8253b890-33c3-4c25-961c-e88cce1b8eff in Status: SUCCESS [ 866.861961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.881020] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.881020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.881020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.881318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.881318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.895220] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 867.083617] env[65162]: INFO networking_nsxv3.common.synchronization [req-d233f162-3e9c-474e-975a-5f8f4da98c55 req-36580696-d6d8-47d9-a219-605e03f6f81a service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 867.083803] env[65162]: INFO networking_nsxv3.common.synchronization [req-d233f162-3e9c-474e-975a-5f8f4da98c55 req-36580696-d6d8-47d9-a219-605e03f6f81a service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 867.083938] env[65162]: INFO networking_nsxv3.common.synchronization [req-d233f162-3e9c-474e-975a-5f8f4da98c55 req-36580696-d6d8-47d9-a219-605e03f6f81a service nova] Enqueued Resource ID: 727b5ad5-4d1f-4c71-8dd5-f833cda569e3 with Priority: HIGHEST for action port [ 867.084501] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 867.084636] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 867.084732] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 727b5ad5-4d1f-4c71-8dd5-f833cda569e3 with Priority: HIGHEST for action port [ 867.085143] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.085282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.085335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.085531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.085611] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.086846] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.086957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.087154] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.087268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.087319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.087499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.087544] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('727b5ad5-4d1f-4c71-8dd5-f833cda569e3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.223668] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.246633] env[65162]: INFO networking_nsxv3.common.synchronization [req-3134c38f-0947-4909-b11c-a20c17c722a6 req-3fe98c1d-19c8-4808-a8f4-3afb977db4d9 tempest-ServersTestBootFromVolume-331407756 tempest-ServersTestBootFromVolume-331407756-project-member] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_members [ 867.247646] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGHEST for action security_group_members [ 867.248011] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.248277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.248345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.248613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.248840] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.248977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.249077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.250188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.250346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.250476] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.343882] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 867.343882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.344056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.344160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.344354] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.344472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.344539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.344691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.344772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.344858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.344979] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.591014] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.591185] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.591386] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 727b5ad5-4d1f-4c71-8dd5-f833cda569e3 with status ACTIVE [ 867.591575] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.591681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.591759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.592016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.592113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.592287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.592387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.592450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.592609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.592685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.592908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.593045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.593045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.593167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.593223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.593303] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 727b5ad5-4d1f-4c71-8dd5-f833cda569e3 is going to be updated. [ 867.625340] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.625660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.625660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.625874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.625961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.626170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-727b5ad5-4d1f-4c71-8dd5-f833cda569e3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.726836] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.752392] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.752778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.752778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.752910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.753094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.753305] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.753413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.753476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.753674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.753760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.753839] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 is going to be updated. [ 867.810612] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.811010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.811179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.811367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.812188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.820760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 867.820944] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 867.821081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.821646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.821865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.822062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.822182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.822247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.822396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.822492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.822630] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.827108] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: IN_PROGRESS for 2s [ 867.847576] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.848091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.848211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.849225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.849225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.849225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.849225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.849745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.849745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.849745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.849955] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.849955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.850073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.850180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.850525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.850525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.850525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.850727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.850727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.850842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.850893] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.230916] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.231052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.231099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.231294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.231386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.231483] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 868.279612] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.279789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.279833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.280057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.280500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.297987] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 868.328365] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.358097] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 868.376482] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.376693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.376693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.376912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.376996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.377618] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.377788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.377884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.378916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.378916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.379488] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.379488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.379488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.381254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.381254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.381505] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.381778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.381778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.381952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.381952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.382118] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 868.453554] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.453554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.453554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.453554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.453554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.462501] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 in Status: SUCCESS [ 868.462501] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 deletion is rescheduled due to dependency. [ 868.462501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.472579] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 868.830571] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.908047] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 868.908593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.909422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.909760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.910105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.910304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.910433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.910739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.910883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.911100] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.335952] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.335952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.335952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.335952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.335952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.335952] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 869.381436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.381713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.381713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.381890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.382054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.392060] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 869.414487] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.838209] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 in Status: SUCCESS [ 869.838443] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 deletion is rescheduled due to dependency. [ 869.838509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.857199] env[65162]: INFO networking_nsxv3.common.synchronization [req-5352026a-0aa2-45e3-b825-c26ee6b125dd req-45c7fbcd-752e-4bba-8a70-b89d45206d77 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 869.857951] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 869.859037] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.859171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.874593] env[65162]: INFO networking_nsxv3.common.synchronization [req-5352026a-0aa2-45e3-b825-c26ee6b125dd req-45c7fbcd-752e-4bba-8a70-b89d45206d77 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 869.874808] env[65162]: INFO networking_nsxv3.common.synchronization [req-5352026a-0aa2-45e3-b825-c26ee6b125dd req-45c7fbcd-752e-4bba-8a70-b89d45206d77 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 869.874909] env[65162]: INFO networking_nsxv3.common.synchronization [req-5352026a-0aa2-45e3-b825-c26ee6b125dd req-45c7fbcd-752e-4bba-8a70-b89d45206d77 tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 31a6ff26-d421-451e-973d-bc991354e390 with Priority: HIGHEST for action port [ 869.875683] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_rules [ 869.875825] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 869.875945] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a6ff26-d421-451e-973d-bc991354e390 with Priority: HIGHEST for action port [ 869.876317] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.876417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.876616] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.876746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.876866] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a6ff26-d421-451e-973d-bc991354e390 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.876983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.877034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.877238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.877319] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a6ff26-d421-451e-973d-bc991354e390',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.921441] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.143827] env[65162]: INFO networking_nsxv3.common.synchronization [req-abe7765d-df0f-4a80-aae3-5fc9d7b4b3d7 req-1f6b7ef4-6694-4e1d-ba0f-efa845d800e3 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 870.145666] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 870.145666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.145666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.145666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.145666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.146762] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.146762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.146762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.146762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.146762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.146762] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.313591] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 870.313814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.378995] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31a6ff26-d421-451e-973d-bc991354e390 with status ACTIVE [ 870.379362] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.379521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.379521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.379738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.379829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.380020] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.380156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.380201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.380332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.380405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.380605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.380710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.380768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.380951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.381034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.381122] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31a6ff26-d421-451e-973d-bc991354e390 is going to be updated. [ 870.407486] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.409021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.409021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.409021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.409021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.409594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a6ff26-d421-451e-973d-bc991354e390" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.426035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.426035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 870.477226] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.477226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.477226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.478394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.478394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.493206] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 870.500367] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 870.500367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.615203] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.615425] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.615590] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.615795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.616389] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.616637] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.616797] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.617986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.617986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.617986] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.617986] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.617986] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.617986] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.617986] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.618294] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.618294] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.643521] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.643742] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.643805] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.643954] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.644339] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-c277e602-6b8b-4004-bc9c-051418b5d5d3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.644547] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.644622] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.644970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.645132] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c277e602-6b8b-4004-bc9c-051418b5d5d3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.649325] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.154546] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.154995] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.154995] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.155451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.155766] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.156119] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port c277e602-6b8b-4004-bc9c-051418b5d5d3 not found, creating... [ 871.156591] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.156915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.158484] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.158918] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.159147] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.159991] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.160390] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.160660] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.161142] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.161516] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.161840] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 is going to be created. [ 871.164086] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.193245] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.193245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.193245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.193245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.193245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.193245] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.200974] env[65162]: INFO networking_nsxv3.common.synchronization [req-d13bee0c-8e1f-4f27-b74a-097c78a82e89 req-e2b922e1-7c39-4224-9600-bdba5128ecc3 tempest-MigrationsAdminTest-350875998 tempest-MigrationsAdminTest-350875998-project-member] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 871.201286] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 871.201758] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.201758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.201964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.202181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.202427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.202576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.202576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.202733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.202827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.203698] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.406026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.406026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.406026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.406950] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.667796] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.668057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.668142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.668388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.668498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.668596] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 871.705415] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.714558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.714775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.714775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.714999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.715246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.728723] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 871.911759] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.913803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.913803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.913936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.914184] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.914316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.914416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.914613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.914707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.914797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.914950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.915099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.915184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.915310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.915449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.915541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.915601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.915736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.915811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.915895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.916016] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.920134] env[65162]: INFO networking_nsxv3.common.synchronization [req-abe7765d-df0f-4a80-aae3-5fc9d7b4b3d7 req-2c2343e6-9018-40f0-8d2f-55abbea61f06 service nova] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 871.921679] env[65162]: INFO networking_nsxv3.common.synchronization [req-abe7765d-df0f-4a80-aae3-5fc9d7b4b3d7 req-2c2343e6-9018-40f0-8d2f-55abbea61f06 service nova] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 871.921974] env[65162]: INFO networking_nsxv3.common.synchronization [req-abe7765d-df0f-4a80-aae3-5fc9d7b4b3d7 req-2c2343e6-9018-40f0-8d2f-55abbea61f06 service nova] Enqueued Resource ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 with Priority: HIGHEST for action port [ 871.923538] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 871.923717] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 871.923849] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 with Priority: HIGHEST for action port [ 871.924511] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.925371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.925601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.925828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.925946] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.927176] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.927318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.927548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c277e602-6b8b-4004-bc9c-051418b5d5d3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.927678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.927764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.927984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.928448] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c277e602-6b8b-4004-bc9c-051418b5d5d3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.208219] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.424485] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55eb5d3-a252-4f36-9046-1505d8f8fa4e: rpc.has_security_group_logging(os_id): False [ 872.430517] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.430674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.430907] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c277e602-6b8b-4004-bc9c-051418b5d5d3 with status ACTIVE [ 872.431151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.431282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.431404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.431699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.431847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.431995] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.432112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.432173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.432436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.432436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.432701] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.432873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.433033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.433573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.433674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.433821] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 is going to be updated. [ 872.448266] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.448457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.448606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.448745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.448824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.449259] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.449259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.449259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.449452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.449536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.449699] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.449799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.449860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.450026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.450105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.450282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.450373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.450426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.452865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.453021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.453116] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 872.460497] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.460684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.460759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.460950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.461116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.461284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507108] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.507108] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.507108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507874] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.508794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.508979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.509322] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.509456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.509530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.509703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.509792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.509892] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.540942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.541131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.541131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.541302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.541541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.572602] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 872.678023] env[65162]: INFO networking_nsxv3.common.synchronization [req-c106a8f5-dd4a-41e3-b5e6-9b2db8b31553 req-df359b1d-85a1-42ac-9145-2a9ed4f9b729 tempest-FloatingIPsAssociationNegativeTestJSON-523380269 tempest-FloatingIPsAssociationNegativeTestJSON-523380269-project-member] Enqueued Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_members [ 872.678261] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGHEST for action security_group_members [ 872.678700] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.681013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.681013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.681013] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.712131] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.712343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.712343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.712589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.716030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.716030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be updated. [ 872.746204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.746204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.746204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.746204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.746491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.757452] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 873.013498] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.014661] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.189022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.189022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.189022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.189022] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8402ae4d-ae29-4339-9c47-47671f8a297d is going to be updated. [ 873.219517] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.219924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.219924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.219924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.220097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.236475] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8402ae4d-ae29-4339-9c47-47671f8a297d in Status: IN_PROGRESS for 2s [ 873.522167] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56db26ed-c49a-44f4-95c8-7daf9b19435e: rpc.has_security_group_logging(os_id): False [ 873.522167] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.540767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.540767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.540767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.541076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.541076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.541398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.541398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.541398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.541582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.541751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.541839] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 873.630751] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.630751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.630751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.630751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.633497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.647793] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 873.745320] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.745320] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.745320] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.025111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.025111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.025111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.025534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.026705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.026705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 874.072357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.072525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.072594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.073393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.073393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.086385] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 874.249061] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.588885] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 874.589217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.753019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.770344] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 874.772021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.197191] env[65162]: INFO networking_nsxv3.common.synchronization [req-6085bcca-6ed5-4bfc-84f4-ee77994c99d0 req-37c36566-aa93-45ab-ba8b-7f7a2e9eb785 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 875.197910] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 875.198427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.198653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.198827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.199241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.199527] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.199770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.199922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.200217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.200405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.200595] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.253550] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8402ae4d-ae29-4339-9c47-47671f8a297d in Status: SUCCESS [ 875.254077] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8402ae4d-ae29-4339-9c47-47671f8a297d deletion is rescheduled due to dependency. [ 875.254077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.255585] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.255935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.255935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.256232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.256376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.256516] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 875.325463] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.325768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.325768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.326047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.326047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.343249] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 875.664150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 875.664425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.665385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.665385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.665385] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.703808] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.704295] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.704295] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.704421] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.704673] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.704836] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.704926] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.705834] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.705834] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.705834] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.705834] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.705834] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.706127] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.706127] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.706255] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.706406] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.707626] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.707752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.707838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.707952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.708049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.708217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.708319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.708378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.708679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.708679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.708679] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e already deleted. [ 875.710097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.733516] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.733765] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.733839] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.734142] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.734324] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-27fd8997-3898-4a28-911f-23f0537ae3a6 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.734493] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.734622] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.734932] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.735126] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27fd8997-3898-4a28-911f-23f0537ae3a6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.818337] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4342247-beb0-45fc-9d05-5ada4dd64c99 req-d3835e85-af9d-4fca-987e-1be1d7de8b35 tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 875.818876] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 875.819287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.819357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.819403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.819741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.819811] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.819868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.819921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.822111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.822259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.825167] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.099037] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 876.099037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.099037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.099365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.099477] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.099574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.099665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.099863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.099977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.100139] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.168351] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.168589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.203451] env[65162]: INFO networking_nsxv3.common.synchronization [req-25d95c40-997f-422a-a5d6-6cf93e55a21f req-d3f6d7d6-5446-40a9-9e8d-3f9c2cec20ec tempest-AttachInterfacesUnderV243Test-658968837 tempest-AttachInterfacesUnderV243Test-658968837-project-member] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 876.204080] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGHEST for action security_group_members [ 876.204507] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.204507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.238518] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.238903] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.239146] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.239586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.239848] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.240136] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 27fd8997-3898-4a28-911f-23f0537ae3a6 not found, creating... [ 876.240607] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.240880] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.241104] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.241487] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.241738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.242264] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.242553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.242786] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.243209] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.243477] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.243743] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 27fd8997-3898-4a28-911f-23f0537ae3a6 is going to be created. [ 876.269299] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.269734] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.269927] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.270429] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.270746] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.271544] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.327790] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.564438] env[65162]: INFO networking_nsxv3.common.synchronization [req-5d368c39-ac33-437c-b60f-7660c21a1b89 req-bb519579-38e2-4d6e-9624-38360cbb9218 tempest-ServerGroupTestJSON-1607907676 tempest-ServerGroupTestJSON-1607907676-project-member] Enqueued Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_members [ 876.565249] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGHEST for action security_group_members [ 876.565650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.565778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.565842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.566100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.566283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.566392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.566450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.566622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.566709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.566803] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.603219] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.762222] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ea958f5a-8090-44ed-b0c9-b393ffeacb41 None None] Enqueued Resource ID: 2712bcc9-a8bb-402b-80cb-cfd91023792c with Priority: HIGHEST for action port [ 876.762951] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2712bcc9-a8bb-402b-80cb-cfd91023792c with Priority: HIGHEST for action port [ 876.763914] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2712bcc9-a8bb-402b-80cb-cfd91023792c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.763914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2712bcc9-a8bb-402b-80cb-cfd91023792c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.763914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2712bcc9-a8bb-402b-80cb-cfd91023792c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.764274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2712bcc9-a8bb-402b-80cb-cfd91023792c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.764274] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2712bcc9-a8bb-402b-80cb-cfd91023792c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.830851] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.000018] env[65162]: INFO networking_nsxv3.common.synchronization [req-6085bcca-6ed5-4bfc-84f4-ee77994c99d0 req-fdc76fad-3569-41b8-8117-2853bcfb7589 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 877.000018] env[65162]: INFO networking_nsxv3.common.synchronization [req-6085bcca-6ed5-4bfc-84f4-ee77994c99d0 req-fdc76fad-3569-41b8-8117-2853bcfb7589 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 877.000018] env[65162]: INFO networking_nsxv3.common.synchronization [req-6085bcca-6ed5-4bfc-84f4-ee77994c99d0 req-fdc76fad-3569-41b8-8117-2853bcfb7589 service nova] Enqueued Resource ID: 27fd8997-3898-4a28-911f-23f0537ae3a6 with Priority: HIGHEST for action port [ 877.004164] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 877.004164] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 877.004164] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27fd8997-3898-4a28-911f-23f0537ae3a6 with Priority: HIGHEST for action port [ 877.004164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.004164] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.004164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.004164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.004164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.005387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.005387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.005387] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.006295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-27fd8997-3898-4a28-911f-23f0537ae3a6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.009281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.009281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.009281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.009281] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27fd8997-3898-4a28-911f-23f0537ae3a6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.069857] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.070637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.070637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.070637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.070637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.070854] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.071032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.071106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.071244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.071321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.071412] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8253b890-33c3-4c25-961c-e88cce1b8eff is going to be updated. [ 877.102529] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.102529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.102529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.102975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.103166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.105223] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.113490] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8253b890-33c3-4c25-961c-e88cce1b8eff in Status: IN_PROGRESS for 2s [ 877.267346] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2712bcc9-a8bb-402b-80cb-cfd91023792c [ 877.267697] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.267891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.268021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.268337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.269349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.269349] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2712bcc9-a8bb-402b-80cb-cfd91023792c already deleted. [ 877.269349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2712bcc9-a8bb-402b-80cb-cfd91023792c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.333208] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.333393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.333469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.333715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.333832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.333948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 877.353291] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 877.353291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.353508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.353738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.354065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.354259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.354372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.354641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.354787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.354932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.355165] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.366518] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.366725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.366725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.367058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.367058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.377016] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 877.512516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.512738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.512963] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.513936] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27fd8997-3898-4a28-911f-23f0537ae3a6 with status ACTIVE [ 877.514171] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.514286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.514355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.514569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.514648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.514822] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.514915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.514987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.516129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.516257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.516488] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.516751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.516751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.517567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.517747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.518354] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27fd8997-3898-4a28-911f-23f0537ae3a6 is going to be updated. [ 877.547533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.547715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.547808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.548169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.548273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.548441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27fd8997-3898-4a28-911f-23f0537ae3a6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.609775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.609775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.609775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.609775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.609775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.609775] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 877.683520] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.683752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.683752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.684088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.684206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.700493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 877.858658] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.858858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.858911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.859180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.859348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.859445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.859521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.859683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.859873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.859873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.860017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.860127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.860172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.860310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.860501] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.861023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.861023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.861023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.861023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.861023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.861271] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.023199] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.363395] env[65162]: INFO networking_nsxv3.common.synchronization [req-2885f29a-e02e-4a1d-87b9-274d56f32999 req-34871679-73d8-4686-babf-1e78a72ecd8d tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_members [ 878.363725] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9750e22b-5fab-447f-83f8-693fd5c74e09: rpc.has_security_group_logging(os_id): False [ 878.366172] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_members [ 878.366744] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.366873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.366941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.367219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.367398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.367506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.367570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.367865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.367865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.367957] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.386877] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.386877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.386877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.387216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.387216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.387480] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.387583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.387643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.387805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.387878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.388064] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.388157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.388217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.388349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.388418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.388789] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.388789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.388789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.388992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.388992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.388992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 878.454138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.456321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.456321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.456321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.456321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.473315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 878.535843] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.536418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.536531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.536731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.536862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.537292] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be created. [ 878.653073] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.655120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.655120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.655120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.655120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.680445] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: UNINITIALIZED for 2s [ 878.792454] env[65162]: INFO networking_nsxv3.common.synchronization [None req-83c9db0f-2b44-4fe3-b950-bf8988250d0c None None] Enqueued Resource ID: 04fa27de-bbef-47a8-a541-7dbdadb0bb27 with Priority: HIGHEST for action port [ 878.793171] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04fa27de-bbef-47a8-a541-7dbdadb0bb27 with Priority: HIGHEST for action port [ 878.793542] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-04fa27de-bbef-47a8-a541-7dbdadb0bb27 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.793675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04fa27de-bbef-47a8-a541-7dbdadb0bb27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.793744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04fa27de-bbef-47a8-a541-7dbdadb0bb27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.794016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04fa27de-bbef-47a8-a541-7dbdadb0bb27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.795446] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fa27de-bbef-47a8-a541-7dbdadb0bb27',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.812363] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.812588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.812679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.812978] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.813650] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.813827] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.813947] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.814205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.814354] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.814570] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.814670] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.814779] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.814884] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.814991] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.815398] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.815676] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.838159] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.838455] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.838694] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.838997] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.839501] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.839793] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.840118] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.840646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.840875] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd7efe6-386e-4f86-9fd6-4cce46c4d080',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.871223] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.871462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.871462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.871670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.871759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.871993] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.883068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.883068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.883068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.883068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.883068] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 already deleted. [ 878.883068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.129219] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8253b890-33c3-4c25-961c-e88cce1b8eff in Status: SUCCESS [ 879.129371] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8253b890-33c3-4c25-961c-e88cce1b8eff deletion is rescheduled due to dependency. [ 879.129441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.298263] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04fa27de-bbef-47a8-a541-7dbdadb0bb27 [ 879.298581] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.298801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.298926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.299192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.299285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.299413] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04fa27de-bbef-47a8-a541-7dbdadb0bb27 already deleted. [ 879.299579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04fa27de-bbef-47a8-a541-7dbdadb0bb27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.344317] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.344317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.344317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.344705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.344911] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.346086] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port bfd7efe6-386e-4f86-9fd6-4cce46c4d080 not found, creating... [ 879.346410] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.346662] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.346883] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.347318] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.347575] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.348189] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.348486] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.348688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.349093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.349335] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.349576] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: bfd7efe6-386e-4f86-9fd6-4cce46c4d080 is going to be created. [ 879.380271] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.380664] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.380664] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.381385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.381385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.381555] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.421667] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 879.421941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.711718] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 879.712655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.712655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.712958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.713433] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.713720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.713863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.714162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.714317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.714499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.714673] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.715928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.716988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.716988] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.716988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.716988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.717226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.717226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.717329] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.133842] env[65162]: INFO networking_nsxv3.common.synchronization [req-2885f29a-e02e-4a1d-87b9-274d56f32999 req-fd5062a7-3d0c-4028-a79a-c45d87d8ef0e service nova] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_rules [ 880.133842] env[65162]: INFO networking_nsxv3.common.synchronization [req-2885f29a-e02e-4a1d-87b9-274d56f32999 req-fd5062a7-3d0c-4028-a79a-c45d87d8ef0e service nova] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_members [ 880.133842] env[65162]: INFO networking_nsxv3.common.synchronization [req-2885f29a-e02e-4a1d-87b9-274d56f32999 req-fd5062a7-3d0c-4028-a79a-c45d87d8ef0e service nova] Enqueued Resource ID: bfd7efe6-386e-4f86-9fd6-4cce46c4d080 with Priority: HIGHEST for action port [ 880.134499] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_rules [ 880.134695] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_members [ 880.134756] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd7efe6-386e-4f86-9fd6-4cce46c4d080 with Priority: HIGHEST for action port [ 880.135148] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.135339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.135421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.135623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.135970] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.137632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.137776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.137846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.138069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.138229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.138414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.138503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.138631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.138717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.138816] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.143468] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.143633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.143688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.143901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.144034] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd7efe6-386e-4f86-9fd6-4cce46c4d080',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.219877] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.220780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.221013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.221101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.221372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.221437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.221681] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.221817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.221817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.221936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.221999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.222198] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 880.255655] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.255815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.255912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.256274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.256522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.269589] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 880.490202] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 880.490539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.647380] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.647380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.649367] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.653124] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfd7efe6-386e-4f86-9fd6-4cce46c4d080 with status ACTIVE [ 880.653124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.653124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.653124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.653124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.654095] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfd7efe6-386e-4f86-9fd6-4cce46c4d080 is going to be updated. [ 880.687384] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.687384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.687384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.687384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.687384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.687384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfd7efe6-386e-4f86-9fd6-4cce46c4d080" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.696300] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 880.696538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.696857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.696996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.697682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.697682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.697682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.698029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.698029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.698029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.698146] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.727186] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56db26ed-c49a-44f4-95c8-7daf9b19435e: rpc.has_security_group_logging(os_id): False [ 880.747385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.748101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.748101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.748394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.748493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.748694] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.748817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.748883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.749323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.749323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.749323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be updated. [ 880.864062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.864208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.864280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.864491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.864671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.879758] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: IN_PROGRESS for 2s [ 881.156371] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.202022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.202188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.202188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.202436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.202625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.202774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.202901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.203014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.203378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.203378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.203378] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.203706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.203842] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.204161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.204289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.204393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.204586] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.390476] env[65162]: INFO networking_nsxv3.common.synchronization [req-a948b021-26fb-4684-a985-4fc677b77180 req-7516cd99-cdf0-4866-8987-734b16a592dc tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 881.391146] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 881.391882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.392063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.392362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.392695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.394846] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.394846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.394846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.394846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.394846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.394846] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.658875] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.659797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.659797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.659797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.659797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.659797] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 is going to be created. [ 881.687771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.687964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.688018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.688202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.688367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.699012] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 in Status: UNINITIALIZED for 2s [ 881.709296] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7fd6bec-6820-40d4-9564-ee5cb9c2521e: rpc.has_security_group_logging(os_id): False [ 881.726612] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.726765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.726842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.728180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.728351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.728609] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.728739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.728806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.728978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.729073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.729266] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.729362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.729415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.729563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.729636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.729812] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.729903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.729962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.730216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.730296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.730383] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be created. [ 881.816641] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.816934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.816934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.817074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.817231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.831993] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 881.898299] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.898590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.898590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.898800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.898873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.899500] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.899500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.899500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.899500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.899500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.900092] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 881.964458] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.964458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.964458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.964681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.965355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.975432] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 881.975902] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 881.976929] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 881.977270] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 881.977456] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.977613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.977706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.978374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.978374] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.978515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.978515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.978794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.978794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.978894] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.980130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.981460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.981460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.981643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.982476] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.982476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.982476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.982476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.982476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.982476] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.984945] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 882.056140] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 882.060701] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 882.060821] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_rules [ 882.061066] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 882.061299] env[65162]: INFO networking_nsxv3.common.synchronization [req-554f20dc-c97c-48dd-9c87-a89fe1685841 req-a2fd89e7-738e-4442-873c-b702d5589630 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 with Priority: HIGHEST for action port [ 882.062151] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 882.062362] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_rules [ 882.062536] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 with Priority: HIGHEST for action port [ 882.062707] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 882.062854] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 882.063564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.066322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.066505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.067086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.067214] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.068787] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.068995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.069116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.069556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.069809] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.072214] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c277e602-6b8b-4004-bc9c-051418b5d5d3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.072214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.072214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.072214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.072214] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c277e602-6b8b-4004-bc9c-051418b5d5d3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.074221] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.074221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.074221] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.074221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.282479] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 882.282479] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e deletion is rescheduled due to dependency. [ 882.282479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.485788] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.487609] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.575883] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.576449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.576820] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.576929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.577121] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c277e602-6b8b-4004-bc9c-051418b5d5d3 with status ACTIVE [ 882.577300] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.577528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.577587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.577821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.577910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.578125] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.578277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.578344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.578501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.578606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.578813] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.578949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.579036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.579180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.579266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.579369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 is going to be updated. [ 882.605845] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.606172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.606580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.606866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.607173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.607351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.899857] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e in Status: SUCCESS [ 882.900208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.990711] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.991686] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.493787] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.494341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.494341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.494483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.494483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.495135] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be created. [ 883.496153] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.496308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.496382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.496578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.496578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.497183] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 883.527688] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.527913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.528031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.528356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.528638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.538111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.538421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.538509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.538811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.539046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.544738] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: UNINITIALIZED for 2s [ 883.551199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 883.713106] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 in Status: SUCCESS [ 883.713842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.713842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.713842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.714509] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.714784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.714784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.716035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.716035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.716035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.716035] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.847013] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 883.847264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.002699] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 884.003527] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 884.003527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.129348] env[65162]: INFO networking_nsxv3.common.synchronization [req-1e61f8f0-3e1d-478c-bdd0-6d19262943f4 req-10345a8c-64c9-4f5c-a29c-127786c35052 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 884.129348] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 884.129348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.129348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.129348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.129348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.129348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.129348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.129348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.130236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.130236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.130236] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.220040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.632948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.633204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.633204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.633457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.633568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.633809] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.633936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.634009] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.634221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.634305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.634393] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 already deleted. [ 884.634477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.700079] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.700274] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.700395] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.700734] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.701028] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.701183] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.701385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.701611] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.701976] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.701976] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.702203] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.702343] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.702510] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.702577] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.702889] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.703030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.724019] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9524ba2d-0871-4060-bb89-ad3d899c17e8: rpc.has_security_group_logging(os_id): False [ 884.725012] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.725281] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.725494] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.725693] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.726159] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-27c46269-a14b-49b9-b1e4-9bec9540962e taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.726464] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.726902] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.726989] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.727188] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c46269-a14b-49b9-b1e4-9bec9540962e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.749224] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.749444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.749444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.749623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.749714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.750788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.750788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.750788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.750788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.750788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.750788] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 is going to be created. [ 884.823095] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.823095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.823095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.823095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.823095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.838666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 in Status: IN_PROGRESS for 2s [ 885.231228] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.232287] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.232487] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.232793] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.232948] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.233170] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 27c46269-a14b-49b9-b1e4-9bec9540962e not found, creating... [ 885.233478] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.233687] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.233792] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.234027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.234172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.234668] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.234668] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.234915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.235232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.235368] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.235585] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 27c46269-a14b-49b9-b1e4-9bec9540962e is going to be created. [ 885.277546] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.277801] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.277930] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.278224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.278476] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.278805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.559677] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 885.560373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.562019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.562019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.562019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.562019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.562019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.562019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.562019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.563385] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.566145] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 885.566145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.566360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.566939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.566939] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.566939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.566939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.567319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.567319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.567319] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.021723] env[65162]: INFO networking_nsxv3.common.synchronization [req-1e61f8f0-3e1d-478c-bdd0-6d19262943f4 req-b8ee97d8-83d7-44a7-92bf-3e8bad23892b service nova] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 886.021910] env[65162]: INFO networking_nsxv3.common.synchronization [req-1e61f8f0-3e1d-478c-bdd0-6d19262943f4 req-b8ee97d8-83d7-44a7-92bf-3e8bad23892b service nova] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 886.022061] env[65162]: INFO networking_nsxv3.common.synchronization [req-1e61f8f0-3e1d-478c-bdd0-6d19262943f4 req-b8ee97d8-83d7-44a7-92bf-3e8bad23892b service nova] Enqueued Resource ID: 27c46269-a14b-49b9-b1e4-9bec9540962e with Priority: HIGHEST for action port [ 886.022712] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 886.022848] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 886.022948] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27c46269-a14b-49b9-b1e4-9bec9540962e with Priority: HIGHEST for action port [ 886.023254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.023379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.023447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.024177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.024177] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.024606] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.024719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.024783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.024947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.025110] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.025202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.025270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.025394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.025480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.025571] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.027604] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-27c46269-a14b-49b9-b1e4-9bec9540962e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.027755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.027821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.027945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.028049] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c46269-a14b-49b9-b1e4-9bec9540962e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.069174] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.070427] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.532728] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.533895] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.535014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27c46269-a14b-49b9-b1e4-9bec9540962e with status ACTIVE [ 886.535296] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.535493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.535559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.535784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.535866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.537524] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.539052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.539052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.539052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.539585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.539867] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.539963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.540053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.540272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.540582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.540724] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27c46269-a14b-49b9-b1e4-9bec9540962e is going to be updated. [ 886.565578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.567409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.567578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.567796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.567957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.568145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27c46269-a14b-49b9-b1e4-9bec9540962e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.572033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.574490] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.850874] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 in Status: SUCCESS [ 886.851169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.042612] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.075034] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.075279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.075655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.075655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.075835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.075835] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be updated. [ 887.077144] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.077292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.077336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.077512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.077617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.077682] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 887.108209] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.108438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.108554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.109326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.109707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.113070] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.113266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.113387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.113686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.114259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.125504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 887.126409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: IN_PROGRESS for 2s [ 887.548519] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.548881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.548961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.549204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.549300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.549403] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be created. [ 887.579617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.580969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.580969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.580969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.580969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.595447] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: UNINITIALIZED for 2s [ 889.137279] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 889.137603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.137816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.138141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.138371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.138554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.138648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.138852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.138961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.139083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.139203] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.141463] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 889.141698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.142236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.142462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.146358] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.146486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.146545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.146718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.146821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.146932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.147043] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.610127] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 889.610127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.610127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.610344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.610570] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.610707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.610750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.610915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.611059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.611098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.611188] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.651290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651686] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.651686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.651686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.651845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.652042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.652042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.652191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.652437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.652674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.652804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.652878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.654527] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.114761] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.158373] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dda58912-2918-4cc8-9735-fc69849b0476: rpc.has_security_group_logging(os_id): False [ 890.159790] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9750e22b-5fab-447f-83f8-693fd5c74e09: rpc.has_security_group_logging(os_id): False [ 890.184416] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.184612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.184688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.184917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.185632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.186075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.186257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.186591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.186820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.186950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.187081] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be created. [ 890.190797] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.191328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.191459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.191907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.191987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.192268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.192396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.192715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.192926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.193045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.193297] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.193432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.193703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.193925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.194018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.194253] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.194368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.194434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.194613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.194712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.197137] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 890.304561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.304907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.305090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.305996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.305996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.338282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.339096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.339096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.339458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.339673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.348808] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: IN_PROGRESS for 2s [ 890.374681] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 890.620745] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e983155-2c0f-440c-885b-2648c7ee2a33: rpc.has_security_group_logging(os_id): False [ 890.647853] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.648048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.648181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.648359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.648466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.648727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.648848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.648924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.649115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.649194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.649303] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be created. [ 890.722877] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.723160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.723305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.723572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.723832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.739311] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 891.024452] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 891.024693] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 891.223744] env[65162]: INFO networking_nsxv3.common.synchronization [req-0c35edf2-66d0-40bc-a69a-6235c1b64e5f req-8c591dc5-25a0-4af3-8600-3c3873f1edf9 tempest-ServersAdminTestJSON-180733585 tempest-ServersAdminTestJSON-180733585-project-member] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 891.224331] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGHEST for action security_group_members [ 891.224755] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.224869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.224936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.225356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.225515] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.225621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.225685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.225848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.225971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.226102] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.730295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.730491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.730532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.730727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.730819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.731031] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.731134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.731196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.731353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.731461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.731554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be updated. [ 891.765068] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.765296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.765414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.765682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.765877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.776134] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: IN_PROGRESS for 2s [ 891.805127] env[65162]: INFO networking_nsxv3.common.synchronization [req-cce01b68-8668-4561-b3a3-f27420609bd8 req-6670ecd6-2834-47c2-91a0-5daded7de9b2 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 891.805945] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 891.806362] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.806507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.806578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.806744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.807230] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.807357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.807577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.807577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.807725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.807788] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.873260] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 891.873370] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_members [ 891.873633] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 891.874567] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 891.874567] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_members [ 891.874793] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 891.875328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.875328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.875328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.875574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.876610] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.876610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.876610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.876610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.876610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.876610] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.877159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d813c855-9a5b-4789-b322-fc73fc195c5d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.877251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.877340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.877516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.877650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.877763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.877800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.877968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.878046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.878113] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.879274] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.879378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.879443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.879589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.879722] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.879840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.879871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.883153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.883153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.883153] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.934105] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 891.934105] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 891.934105] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_rules [ 891.934105] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_members [ 891.934105] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_rules [ 891.934378] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 891.934447] env[65162]: INFO networking_nsxv3.common.synchronization [req-d022a453-d087-4291-b377-34c351289df3 req-43a641da-92e2-4ef1-b6c8-7c9f9f0560d2 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 with Priority: HIGHEST for action port [ 891.934983] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_rules [ 891.935241] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_rules [ 891.935437] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 891.935551] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 with Priority: HIGHEST for action port [ 891.935647] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_rules [ 891.935742] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 891.935834] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_members [ 891.936148] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.936268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.936524] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d813c855-9a5b-4789-b322-fc73fc195c5d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.937381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.937381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.937381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.937381] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.938158] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.938264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.939234] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c277e602-6b8b-4004-bc9c-051418b5d5d3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.939234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.939234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.939234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.939234] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c277e602-6b8b-4004-bc9c-051418b5d5d3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.940026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.940026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.940026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.940026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.940212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d813c855-9a5b-4789-b322-fc73fc195c5d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.940246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.220099] env[65162]: INFO networking_nsxv3.common.synchronization [None req-6462f359-7c18-4f2b-af69-bcb7074a7bb0 None None] Enqueued Resource ID: 369ae521-4c7b-4af2-96d2-0c395b14d63d with Priority: HIGHEST for action port [ 892.221177] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 369ae521-4c7b-4af2-96d2-0c395b14d63d with Priority: HIGHEST for action port [ 892.221177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-369ae521-4c7b-4af2-96d2-0c395b14d63d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.221177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-369ae521-4c7b-4af2-96d2-0c395b14d63d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.221177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-369ae521-4c7b-4af2-96d2-0c395b14d63d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.221358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-369ae521-4c7b-4af2-96d2-0c395b14d63d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.221415] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('369ae521-4c7b-4af2-96d2-0c395b14d63d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.311396] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.311396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.311396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.311396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.311396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.311396] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.311396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.311949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.311949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.311949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.311949] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 892.344139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.344568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.344568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.344717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.344899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.355164] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 892.361739] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 892.361977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.362514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.362514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.362514] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.381961] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.383254] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.385030] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.392978] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 892.392978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.392978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.392978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.392978] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.441250] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d813c855-9a5b-4789-b322-fc73fc195c5d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.441376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.441759] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c277e602-6b8b-4004-bc9c-051418b5d5d3 with status ACTIVE [ 892.441823] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.441880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.441952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.442204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.442257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.442421] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.442516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.442630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.442815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.442895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.443091] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.443185] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.443238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.443380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.443453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.443559] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c277e602-6b8b-4004-bc9c-051418b5d5d3 is going to be updated. [ 892.467614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.467748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.467826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.468070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.468221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.468381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c277e602-6b8b-4004-bc9c-051418b5d5d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.723685] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 369ae521-4c7b-4af2-96d2-0c395b14d63d [ 892.724173] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.724616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.724616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.724906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.725067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.725220] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:369ae521-4c7b-4af2-96d2-0c395b14d63d already deleted. [ 892.725348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-369ae521-4c7b-4af2-96d2-0c395b14d63d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.754938] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 892.754938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.866039] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.866039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.885491] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.886539] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.887304] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.896158] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.896158] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.090021] env[65162]: INFO networking_nsxv3.common.synchronization [req-83991696-4de5-4d2e-8d45-503a9c150eec req-d377fe98-050b-4861-a674-d2e6b61315d8 tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 893.090021] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 893.090342] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.090824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.090899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.091173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.091347] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.091451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.091514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.092662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.092662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.092662] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.381156] env[65162]: INFO networking_nsxv3.common.synchronization [req-95b069f4-d44c-4878-823f-5be8b454a465 req-dbf12a2c-e397-498d-a36c-a0e98fe3ec3a tempest-MigrationsAdminTest-350875998 tempest-MigrationsAdminTest-350875998-project-member] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 893.381695] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGHEST for action security_group_members [ 893.382212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.383150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.383183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.383397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.383584] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.383679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.383743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.387188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.387293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.387400] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.390713] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.390713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.390713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.390881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.390881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.390945] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d813c855-9a5b-4789-b322-fc73fc195c5d is going to be created. [ 893.392124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.392387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.392387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.392487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.392544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.392634] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 893.394720] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.395373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.395519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.397252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.397350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.397573] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be updated. [ 893.424769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.425211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.425211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.425484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.425693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.428627] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.428804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.428902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.429139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.429456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.431433] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.431590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.431748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.431949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.432070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.440774] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 893.441443] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: UNINITIALIZED for 2s [ 893.442043] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: IN_PROGRESS for 2s [ 893.595175] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.595376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.595478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.595745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.595892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.596174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.596294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.596415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.596607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.596846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.596846] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 already deleted. [ 893.596941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.746677] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.747015] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.747244] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.747661] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.748052] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.748292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.748475] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.748859] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.749098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.749402] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.749607] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.749786] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.749957] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.750184] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.750360] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.750554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.770388] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.770648] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.770859] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.771135] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-225" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.771573] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-a4fa09be-41e5-42d5-8384-2f7dd920b236 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.772327] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.772327] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.773156] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.773368] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4fa09be-41e5-42d5-8384-2f7dd920b236',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.785960] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 in Status: SUCCESS [ 893.786408] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 deletion is rescheduled due to dependency. [ 893.786408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.890027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.890027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.890027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.890027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.890027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.890287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.890388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.890429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.890622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.890704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.892237] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be updated. [ 893.926356] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.926506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.926721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.926895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.926953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.936263] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: IN_PROGRESS for 2s [ 894.097528] env[65162]: INFO networking_nsxv3.common.synchronization [None req-8427f337-93eb-4e47-b468-26a0a0761b6a None None] Enqueued Resource ID: 286ad1df-c470-4c28-bcfc-a4427b20b2c7 with Priority: HIGHEST for action port [ 894.098072] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 286ad1df-c470-4c28-bcfc-a4427b20b2c7 with Priority: HIGHEST for action port [ 894.098379] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-286ad1df-c470-4c28-bcfc-a4427b20b2c7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.098534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-286ad1df-c470-4c28-bcfc-a4427b20b2c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.098568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-286ad1df-c470-4c28-bcfc-a4427b20b2c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.098810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-286ad1df-c470-4c28-bcfc-a4427b20b2c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.098904] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286ad1df-c470-4c28-bcfc-a4427b20b2c7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.276452] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.276738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.276883] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.277169] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.277375] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.277504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port a4fa09be-41e5-42d5-8384-2f7dd920b236 not found, creating... [ 894.277765] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.277915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.278039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.278271] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.278450] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.278737] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.278891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.278990] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.279292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.279417] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.279550] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 is going to be created. [ 894.317646] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.318018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.318191] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.318477] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.318745] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.318932] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.367782] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 894.367963] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e deletion is rescheduled due to dependency. [ 894.368099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.601937] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 286ad1df-c470-4c28-bcfc-a4427b20b2c7 [ 894.602298] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.602397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.602476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.602790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.602919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.603041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:286ad1df-c470-4c28-bcfc-a4427b20b2c7 already deleted. [ 894.603182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-286ad1df-c470-4c28-bcfc-a4427b20b2c7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.780342] env[65162]: INFO networking_nsxv3.common.synchronization [req-6b78ff90-706c-47f1-bf38-8b069e2f441e req-79f72cfe-b039-4dfb-bb22-461bb779f4b2 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 894.780972] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 894.781306] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.781497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.781588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.782228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.782228] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.782228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.782578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.782578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.782629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.783010] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.021524] env[65162]: INFO networking_nsxv3.common.synchronization [req-83991696-4de5-4d2e-8d45-503a9c150eec req-9fe182e6-8462-4df0-bc76-5a02cab39f45 service nova] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_rules [ 895.021524] env[65162]: INFO networking_nsxv3.common.synchronization [req-83991696-4de5-4d2e-8d45-503a9c150eec req-9fe182e6-8462-4df0-bc76-5a02cab39f45 service nova] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 895.021524] env[65162]: INFO networking_nsxv3.common.synchronization [req-83991696-4de5-4d2e-8d45-503a9c150eec req-9fe182e6-8462-4df0-bc76-5a02cab39f45 service nova] Enqueued Resource ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 with Priority: HIGHEST for action port [ 895.021524] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_rules [ 895.021524] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 895.021524] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 with Priority: HIGHEST for action port [ 895.021524] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.021940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.022127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.022480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.022670] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.023957] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.024271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.024498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.024772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.025652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.025870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.026052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.026903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.027263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.027454] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.031849] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4fa09be-41e5-42d5-8384-2f7dd920b236 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.031849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.031849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.031849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.031849] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4fa09be-41e5-42d5-8384-2f7dd920b236',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.285178] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.285298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.285373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.285598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.285698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.285928] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.286029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.286094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.286291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.286353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.286429] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 895.341510] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.341658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.341732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.341990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.342358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.355288] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 895.376543] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.377688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.377688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.377688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.377918] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.378115] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.378875] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.378875] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.378875] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.378875] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.379121] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.379121] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.379197] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.379562] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.379562] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.379562] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.409979] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.409979] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.409979] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.409979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.410216] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.410352] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.410471] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.410811] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.410952] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7650bcd-c6c1-4b1b-a28d-392595f3c5a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.456030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 895.456030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.456030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.456030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.456030] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.456030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.456030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.456030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.456483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.456483] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.457996] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: SUCCESS [ 895.457996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.458982] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 895.459173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.459328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.459763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.459763] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.459855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.459855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.459996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.460087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.460181] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.461416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.461559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.462152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.462152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.462152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.462152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.462152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.462396] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.530874] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.534411] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.534411] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4fa09be-41e5-42d5-8384-2f7dd920b236 with status ACTIVE [ 895.534411] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.534411] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.534411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.534913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.534938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.536063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.536063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.536063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.536279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.536279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.536327] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 is going to be updated. [ 895.562881] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.562881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.562881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.563140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.563607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.563607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.915895] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.916305] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.916305] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.916405] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.916559] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.916713] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 not found, creating... [ 895.916971] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.917142] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.917256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.917778] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.917984] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.918390] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.918563] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.918681] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.918943] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.919025] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.919165] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 is going to be created. [ 895.940074] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.940309] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.940436] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.940719] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.940952] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.941213] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.946493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 in Status: SUCCESS [ 895.946664] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 deletion is rescheduled due to dependency. [ 895.946772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.964308] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.965415] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.966423] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.039390] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.405177] env[65162]: INFO networking_nsxv3.common.synchronization [req-84a220bf-f480-4aec-8db9-2eaa57575d93 req-4d540ac3-d613-4def-bcf4-676eabe074f6 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 896.405819] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 896.406166] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.406314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.406382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.406582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.406749] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.406845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.406908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.407087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.407171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.407269] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.467669] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.468718] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.469769] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.542025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.542210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.542289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.542538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.542640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.542752] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be created. [ 896.568587] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.568758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.568758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.568994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.569267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.583021] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: UNINITIALIZED for 2s [ 896.773207] env[65162]: INFO networking_nsxv3.common.synchronization [req-6b78ff90-706c-47f1-bf38-8b069e2f441e req-97b2b74f-9e3f-457a-baa6-1e280158084a service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 896.773207] env[65162]: INFO networking_nsxv3.common.synchronization [req-6b78ff90-706c-47f1-bf38-8b069e2f441e req-97b2b74f-9e3f-457a-baa6-1e280158084a service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 896.773207] env[65162]: INFO networking_nsxv3.common.synchronization [req-6b78ff90-706c-47f1-bf38-8b069e2f441e req-97b2b74f-9e3f-457a-baa6-1e280158084a service nova] Enqueued Resource ID: e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 with Priority: HIGHEST for action port [ 896.773551] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 896.773551] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 896.773551] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 with Priority: HIGHEST for action port [ 896.773797] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.773915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.773980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.774753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.774842] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.779589] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.779675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.779874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.779988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.780065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.780268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.780354] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7650bcd-c6c1-4b1b-a28d-392595f3c5a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.911193] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.911383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.911461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.911678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.911772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.911968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.912087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.913344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.913587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.913683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.913783] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 896.917598] env[65162]: INFO networking_nsxv3.common.synchronization [None req-9d4f7d1e-fc80-4628-9534-02473314b2f7 tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 896.918498] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 896.919252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.919375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.919446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.919736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.919775] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.952331] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.952551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.952642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.952890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.953530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.965119] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 896.971913] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.971913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.971913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.971913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.971913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.971913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d813c855-9a5b-4789-b322-fc73fc195c5d is going to be updated. [ 896.972555] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.972675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.972725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.972876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.972951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.973045] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be updated. [ 896.974239] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.974362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.974430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.974632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.974698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.974743] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 897.012715] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.013246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.013246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.015045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.015045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.016714] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.016847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.016915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.017128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.017263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.020091] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.020221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.020279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.023340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.023340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.036224] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 897.037396] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: IN_PROGRESS for 2s [ 897.038163] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: IN_PROGRESS for 2s [ 897.141692] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.141919] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.142059] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.142359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.142620] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.142777] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.142890] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.143157] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.143311] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.143536] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.143667] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.143784] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.143899] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.144012] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.144118] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.144245] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.164711] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.164915] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.164996] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.165329] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.165753] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.165940] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.166111] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.166494] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.166702] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa8b990-6eb9-4de6-8887-aebcf3771c4c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.282873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.283027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.283253] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 with status ACTIVE [ 897.283481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.283632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.283708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.283987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.284120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.284346] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.284461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.284523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.284731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.284857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.285079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.285229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.285326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.285491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.285576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.285699] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7650bcd-c6c1-4b1b-a28d-392595f3c5a4 is going to be updated. [ 897.326708] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.326918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.326918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.327166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.327312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.327505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7650bcd-c6c1-4b1b-a28d-392595f3c5a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.368700] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 897.368911] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 897.369117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.369348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.369667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.369908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.370100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.370180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.370405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.370517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.370661] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.453069] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.453312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.453312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.453528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.453640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.453715] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a already deleted. [ 897.453804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.661773] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c767a9a4-53ec-4f42-9089-80cf541a2370 tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 897.662816] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 897.664142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.664142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.664142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.664142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.664142] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.669994] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.670465] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.671053] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.671386] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.671730] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.673020] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 9fa8b990-6eb9-4de6-8887-aebcf3771c4c not found, creating... [ 897.673020] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.673020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.673020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.673703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.674052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.674608] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.675039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.675414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.675867] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.677020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.677020] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 9fa8b990-6eb9-4de6-8887-aebcf3771c4c is going to be created. [ 897.700374] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.701891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.701891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.701891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.701891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.701891] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.873451] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.190239] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.191942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.191942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.191942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.191942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.191942] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a already deleted. [ 898.191942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.378579] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.481604] env[65162]: INFO networking_nsxv3.common.synchronization [req-84a220bf-f480-4aec-8db9-2eaa57575d93 req-d8d1a965-7d12-4909-ba52-02b9e9fa4d02 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 898.481604] env[65162]: INFO networking_nsxv3.common.synchronization [req-84a220bf-f480-4aec-8db9-2eaa57575d93 req-d8d1a965-7d12-4909-ba52-02b9e9fa4d02 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 898.481604] env[65162]: INFO networking_nsxv3.common.synchronization [req-84a220bf-f480-4aec-8db9-2eaa57575d93 req-d8d1a965-7d12-4909-ba52-02b9e9fa4d02 service nova] Enqueued Resource ID: 9fa8b990-6eb9-4de6-8887-aebcf3771c4c with Priority: HIGHEST for action port [ 898.481604] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 898.481919] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 898.481919] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa8b990-6eb9-4de6-8887-aebcf3771c4c with Priority: HIGHEST for action port [ 898.482313] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.482457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.482495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.482684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.483120] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.486160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.486160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.486160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.486160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.486160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.486160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.486160] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa8b990-6eb9-4de6-8887-aebcf3771c4c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.596806] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 898.596993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.597157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.597358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.597678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.597678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.597913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.597913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.598182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.598313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.598475] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.881682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.881682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.881682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.881682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.881682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.881682] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 898.913146] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.913304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.913381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.913592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.913741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.925371] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 898.976415] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 898.976613] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 898.976767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.977169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.977169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978922] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.978922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.978922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.978922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.978922] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.989785] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fa8b990-6eb9-4de6-8887-aebcf3771c4c with status ACTIVE [ 898.990111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.990858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.990858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.990858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.991038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.991326] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.991587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.991587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.991800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.991910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.992152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.992289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.992781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.992781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.992781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.992781] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fa8b990-6eb9-4de6-8887-aebcf3771c4c is going to be updated. [ 898.994724] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.996261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.017670] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.017820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.017876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.018379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.018558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.018778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fa8b990-6eb9-4de6-8887-aebcf3771c4c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.052288] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 899.052496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.052665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.052905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.053098] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.053220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.053281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.053458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.053540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.053628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.053721] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.056310] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: SUCCESS [ 899.056310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.057211] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 899.057211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.060186] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.060186] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.060186] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.060186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.060612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.060612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.060612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.060612] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.102022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.102253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.102358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.102701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.102936] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.103197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.103317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.103506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.103597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.103693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.103872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.103974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.104058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.104223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.104407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.104527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.104758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.104999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.105113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.105305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.105411] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.482062] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.563332] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.567132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.567132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.567132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.567132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.567132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.567728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.567728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.567728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.567955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.568152] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.569141] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.608394] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd58f15a-fa3c-491e-8e2b-378722a4cea1: rpc.has_security_group_logging(os_id): False [ 899.632568] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.632724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.632790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.633097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.633144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.633306] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.633403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.633973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.633973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.633973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.633973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.633973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.634221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.634221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.634221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.635054] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.635054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.635054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.635054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.635054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.635054] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be created. [ 899.698056] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.698243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.698295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.699538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.699538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.713222] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 899.984364] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.070549] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9750e22b-5fab-447f-83f8-693fd5c74e09: rpc.has_security_group_logging(os_id): False [ 900.072170] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d813c855-9a5b-4789-b322-fc73fc195c5d: rpc.has_security_group_logging(os_id): False [ 900.072996] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dda58912-2918-4cc8-9735-fc69849b0476: rpc.has_security_group_logging(os_id): False [ 900.092709] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.092921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.093037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.093332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.093471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.093846] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.093941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.094021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.094230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.094344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.094595] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.094719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.094817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.095009] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.099763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.100520] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.100889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.101030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.101305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.101463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.101706] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 900.108024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.108024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.108024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.108024] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d813c855-9a5b-4789-b322-fc73fc195c5d is going to be created. [ 900.110237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.110470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.110648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.110932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.111149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.111486] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.111765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.111870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.113508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.113711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.113895] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be updated. [ 900.285152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.285399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.285471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.285919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.285919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.296845] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.296845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.296845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.298470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.298470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.300225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.300422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.300488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.300733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.301081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.315947] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: IN_PROGRESS for 2s [ 900.377719] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 900.386435] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: IN_PROGRESS for 2s [ 900.487471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.487904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.487904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.487976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.488072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.488221] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 900.567998] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.568155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.568224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.568440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.568789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.583460] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 900.886095] env[65162]: INFO networking_nsxv3.common.synchronization [req-4874f8f4-3526-4edd-a83d-639e513c9540 req-8dfa9902-250e-42f0-8caa-7782ba60182c tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 900.886095] env[65162]: INFO networking_nsxv3.common.synchronization [req-4874f8f4-3526-4edd-a83d-639e513c9540 req-8dfa9902-250e-42f0-8caa-7782ba60182c tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_members [ 900.886239] env[65162]: INFO networking_nsxv3.common.synchronization [req-4874f8f4-3526-4edd-a83d-639e513c9540 req-8dfa9902-250e-42f0-8caa-7782ba60182c tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 900.886869] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGHEST for action security_group_members [ 900.886996] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGHEST for action security_group_members [ 900.887520] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 900.887520] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.887647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.887647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.887841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.888526] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.888526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.888636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.888727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.888790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.888886] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.889994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d813c855-9a5b-4789-b322-fc73fc195c5d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.889994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.889994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.890434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.890524] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.890629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.890693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.890837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.890917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.891015] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.891801] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.891922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.892064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.892134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.892499] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.892499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.892499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.892720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.892773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.892893] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.935443] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 900.935802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.935911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.936128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.936370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.936451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.936544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.936846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.939511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.939628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.939737] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.959140] env[65162]: INFO networking_nsxv3.common.synchronization [req-b06c7894-b77f-4ee1-b7f4-7585b6b407a8 req-6dc7ad7a-2158-49f5-881e-4fa3e24dc84a tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_members [ 900.959140] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 with Priority: HIGHEST for action security_group_members [ 900.959140] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f904e96-f18d-4ef1-be07-0c2f77a78a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.959140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.959511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.959511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.959576] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.959640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.959805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.959855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.959948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.960033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f904e96-f18d-4ef1-be07-0c2f77a78a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.395053] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.395053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.395053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.395343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.395343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.395466] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.395573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.395630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.395793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.395872] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.395960] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be updated. [ 901.397231] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.397338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.398322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.399478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.399629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.400942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.400942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.400942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.400942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.400942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.400942] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d813c855-9a5b-4789-b322-fc73fc195c5d is going to be updated. [ 901.402035] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.434024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.434024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.434024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.434024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.434024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.436870] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.437010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.437143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.437314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.438030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.442820] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.442957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.443112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.443475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.443613] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.443727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.443793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.443967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.444346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.444486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.444976] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.444976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.444976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.444976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.445234] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.445234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.445234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.445456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.445456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.445533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.445574] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.455878] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: IN_PROGRESS for 2s [ 901.456744] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: IN_PROGRESS for 2s [ 901.462588] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.462732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.462803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.463052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.487420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.487754] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.488041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.488041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.489597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.489597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.489597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 is going to be updated. [ 901.529692] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.529692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.529692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.529866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.531281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.542151] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 in Status: IN_PROGRESS for 2s [ 901.731403] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 901.733352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.906446] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.947883] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03c457f4-5193-48c8-99b4-9dd3e8a1a23d: rpc.has_security_group_logging(os_id): False [ 901.968492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.968652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.968724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.968968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.969085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.969301] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.969402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.969467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.969614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.969692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.969861] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.969953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.970025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.970163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.970237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.970509] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.970664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.970754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.970951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.971058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.971150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 902.040784] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.040997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.041117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.041427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.041644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.057821] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 902.335964] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: SUCCESS [ 902.336509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.400255] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 902.400496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.401450] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 902.401689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.412413] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.412639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.412793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.413126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.413264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.413438] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 902.454579] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.454858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.454973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.455303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.455488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.466175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 902.597368] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 902.597734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.598746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.598746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.598746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.598746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.598746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.598746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.598746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.599366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.599366] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.106992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.106992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.106992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.106992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.106992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.107657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.107657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.107657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.107657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.107657] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.475707] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda58912-2918-4cc8-9735-fc69849b0476 in Status: SUCCESS [ 903.476023] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda58912-2918-4cc8-9735-fc69849b0476 deletion is rescheduled due to dependency. [ 903.476102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.477381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d813c855-9a5b-4789-b322-fc73fc195c5d in Status: SUCCESS [ 903.477633] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d813c855-9a5b-4789-b322-fc73fc195c5d deletion is rescheduled due to dependency. [ 903.477699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.556075] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 in Status: SUCCESS [ 903.556909] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f904e96-f18d-4ef1-be07-0c2f77a78a73 deletion is rescheduled due to dependency. [ 903.557159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f904e96-f18d-4ef1-be07-0c2f77a78a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.609218] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 542ab4ea-1934-47eb-b35d-a11a9e723c30: rpc.has_security_group_logging(os_id): False [ 903.629602] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.629879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.629879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.630151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.630151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.631516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.631516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.631516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.631652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.631680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.631873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.631999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.632083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.632226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.632560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.632560] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.632649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.632677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.633543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.633543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.633543] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 903.711089] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.712663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.712663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.712663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.712663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.750392] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 904.074107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 904.074337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.115711] env[65162]: INFO networking_nsxv3.common.synchronization [None req-813b76b2-a4d7-429c-905f-d8e9b0a30cc9 None None] Enqueued Resource ID: 0b9aa18a-3613-459a-bf81-ebe0c46746c3 with Priority: HIGHEST for action port [ 904.117070] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b9aa18a-3613-459a-bf81-ebe0c46746c3 with Priority: HIGHEST for action port [ 904.118120] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b9aa18a-3613-459a-bf81-ebe0c46746c3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.118120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b9aa18a-3613-459a-bf81-ebe0c46746c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.118120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b9aa18a-3613-459a-bf81-ebe0c46746c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.118632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b9aa18a-3613-459a-bf81-ebe0c46746c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.118878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b9aa18a-3613-459a-bf81-ebe0c46746c3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.479214] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 904.479829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.625199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b9aa18a-3613-459a-bf81-ebe0c46746c3 [ 904.625199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.625199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.625199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.625199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.625199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.625199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b9aa18a-3613-459a-bf81-ebe0c46746c3 already deleted. [ 904.625199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b9aa18a-3613-459a-bf81-ebe0c46746c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.770065] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 905.770632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.236648] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ac18ac8d-17ba-4a4d-8f52-b5273231f107 tempest-ServersTestJSON-1771662425 tempest-ServersTestJSON-1771662425-project-member] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_rules [ 907.236912] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_rules [ 907.238536] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.238536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.238622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.239349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.239349] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.251946] env[65162]: INFO networking_nsxv3.common.synchronization [None req-4126ea4a-a1bd-4720-9f10-1e10447b5430 None None] Enqueued Resource ID: c4a1e396-376f-422d-a547-d26165cbbb60 with Priority: HIGHEST for action port [ 907.252488] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a1e396-376f-422d-a547-d26165cbbb60 with Priority: HIGHEST for action port [ 907.253017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4a1e396-376f-422d-a547-d26165cbbb60 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.253017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4a1e396-376f-422d-a547-d26165cbbb60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.253017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4a1e396-376f-422d-a547-d26165cbbb60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.253269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4a1e396-376f-422d-a547-d26165cbbb60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.253354] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4a1e396-376f-422d-a547-d26165cbbb60',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.587394] env[65162]: INFO networking_nsxv3.common.synchronization [req-c70d9e35-9926-48ba-b693-7d26485c03a7 req-348ef817-b21b-47f0-a09f-5b88bbfe2efa tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 907.588215] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 907.588826] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.588826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.588966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.589103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.589264] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.589435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.589435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.589857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.589857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.589857] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.757878] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4a1e396-376f-422d-a547-d26165cbbb60 [ 907.758506] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.758613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.758676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.758915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.759026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.759405] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4a1e396-376f-422d-a547-d26165cbbb60 already deleted. [ 907.759405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4a1e396-376f-422d-a547-d26165cbbb60" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.766169] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.766365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.766450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.766658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.766749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.766842] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 already deleted. [ 907.766925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.781544] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5d1be1c1-a473-4517-831d-11b7623be6d8 tempest-ServersTestJSON-1771662425 tempest-ServersTestJSON-1771662425-project-member] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_rules [ 907.782364] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_rules [ 907.782738] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.782864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.783204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.783204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.783306] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.093310] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.304943] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.305383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.305383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.305544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.305654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.305781] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 already deleted. [ 908.306134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.410277] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.410501] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.410634] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.411117] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.411456] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.411679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.411965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.412256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.412468] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.412725] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.412876] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.413024] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.413188] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.413386] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.413549] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.413737] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.449388] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.449613] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.449764] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.449990] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.451000] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.451000] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.451000] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.451326] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.451473] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be5026e7-5bd2-4a9b-9b57-af1b4ce69451',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.596160] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.953637] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.954208] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.954208] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.954540] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.954719] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.954889] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port be5026e7-5bd2-4a9b-9b57-af1b4ce69451 not found, creating... [ 908.955301] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.955537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.955681] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.955936] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.956172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.956565] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.956922] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.956973] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.957377] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.957634] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.957864] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: be5026e7-5bd2-4a9b-9b57-af1b4ce69451 is going to be created. [ 908.982686] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.982948] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.983087] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.983414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.983687] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.983913] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.099420] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.099561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.099674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.099990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.100151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.100327] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 909.159082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.159354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.159354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.159725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.159910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.171904] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 909.720657] env[65162]: INFO networking_nsxv3.common.synchronization [req-c70d9e35-9926-48ba-b693-7d26485c03a7 req-35ec8de9-5c18-4ad7-9151-c4793a45a491 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 909.720899] env[65162]: INFO networking_nsxv3.common.synchronization [req-c70d9e35-9926-48ba-b693-7d26485c03a7 req-35ec8de9-5c18-4ad7-9151-c4793a45a491 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 909.720958] env[65162]: INFO networking_nsxv3.common.synchronization [req-c70d9e35-9926-48ba-b693-7d26485c03a7 req-35ec8de9-5c18-4ad7-9151-c4793a45a491 service nova] Enqueued Resource ID: be5026e7-5bd2-4a9b-9b57-af1b4ce69451 with Priority: HIGHEST for action port [ 909.721521] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 909.721642] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 909.721734] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be5026e7-5bd2-4a9b-9b57-af1b4ce69451 with Priority: HIGHEST for action port [ 909.722188] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.722262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.722308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.722501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.722581] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.724558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.724558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.724558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.724558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.724558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.724558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.724558] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be5026e7-5bd2-4a9b-9b57-af1b4ce69451',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.227026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.227026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.227254] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be5026e7-5bd2-4a9b-9b57-af1b4ce69451 with status ACTIVE [ 910.227369] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.227559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.227559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.227789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.228102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.228102] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.228234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.228234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.228351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.228422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.228594] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.228672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.228808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.228860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.229134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.229134] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be5026e7-5bd2-4a9b-9b57-af1b4ce69451 is going to be updated. [ 910.252133] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.252275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.252348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.252552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.252692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.252852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be5026e7-5bd2-4a9b-9b57-af1b4ce69451" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.185769] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 911.186191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.186443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.186811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.189159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.189159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.189159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.189159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.189159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.189159] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.691583] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.192912] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.516452] env[65162]: INFO networking_nsxv3.common.synchronization [None req-f60f0176-5620-43b4-8934-44c352c0f15d None None] Enqueued Resource ID: 6dad3e77-a0cc-474e-ac59-33c745a2ec3b with Priority: HIGHEST for action port [ 912.517314] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dad3e77-a0cc-474e-ac59-33c745a2ec3b with Priority: HIGHEST for action port [ 912.518776] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dad3e77-a0cc-474e-ac59-33c745a2ec3b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.519671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dad3e77-a0cc-474e-ac59-33c745a2ec3b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.519671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dad3e77-a0cc-474e-ac59-33c745a2ec3b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.519671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dad3e77-a0cc-474e-ac59-33c745a2ec3b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.519671] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dad3e77-a0cc-474e-ac59-33c745a2ec3b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.696017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.696327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.696395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.696567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.696661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.696828] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 912.731693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.731855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.731855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.732019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.732173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.740822] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 913.023253] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dad3e77-a0cc-474e-ac59-33c745a2ec3b [ 913.024193] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.024389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.024532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.024856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.024979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.025115] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dad3e77-a0cc-474e-ac59-33c745a2ec3b already deleted. [ 913.025226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dad3e77-a0cc-474e-ac59-33c745a2ec3b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.174667] env[65162]: INFO networking_nsxv3.common.synchronization [None req-fdf205ff-d59c-4740-a6fc-40e802e309d5 None None] Enqueued Resource ID: 832c6d77-7a0a-45ea-9608-812d11912fdd with Priority: HIGHEST for action port [ 913.175969] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832c6d77-7a0a-45ea-9608-812d11912fdd with Priority: HIGHEST for action port [ 913.176259] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-832c6d77-7a0a-45ea-9608-812d11912fdd taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.176423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-832c6d77-7a0a-45ea-9608-812d11912fdd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.180258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-832c6d77-7a0a-45ea-9608-812d11912fdd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.180452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-832c6d77-7a0a-45ea-9608-812d11912fdd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.180545] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('832c6d77-7a0a-45ea-9608-812d11912fdd',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.684986] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 832c6d77-7a0a-45ea-9608-812d11912fdd [ 913.685342] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.685418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.685479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.689386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.689496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.689608] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:832c6d77-7a0a-45ea-9608-812d11912fdd already deleted. [ 913.689692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-832c6d77-7a0a-45ea-9608-812d11912fdd" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.758752] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 914.759075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.759294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.759617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.759881] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.760041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.760113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.760299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.760382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.760476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.760822] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.265956] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.269219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.269219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.270351] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.272129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.272129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.272129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.272129] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.272129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.272129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.273043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.273043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.273771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.274337] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.451602] env[65162]: INFO networking_nsxv3.common.synchronization [None req-f32a41a9-7f56-4684-b55a-9259ad61d770 None None] Enqueued Resource ID: c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e with Priority: HIGHEST for action port [ 915.452218] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e with Priority: HIGHEST for action port [ 915.452418] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.452507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.452565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.452848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.453019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.514508] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.514508] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.514508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.514508] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.514508] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.514508] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.514508] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.515374] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.515374] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.515374] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.550721] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.551066] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.551304] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.551629] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-265" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.552137] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-7f443da1-15c5-47e2-887d-0dcb6d2ea209 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.552390] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.552577] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.556028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.556028] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f443da1-15c5-47e2-887d-0dcb6d2ea209',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.777595] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 915.825189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.825189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.825189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.825515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.826162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.826985] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.826985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.826985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.826985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.826985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.827282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.827372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.827449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.827650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.827724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.827941] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.828042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.828413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.828413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.828413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.828413] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 915.935519] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.935683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.935764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.935974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.936142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.953882] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 915.957658] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e [ 915.957658] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.957658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.957658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.957658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.957658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.957658] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e already deleted. [ 915.957658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b10b32-dd0e-46e3-bc9f-d5a7ef89af2e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.056661] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.058035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.058125] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.058402] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.058551] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.058867] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.060325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.060325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.060325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.060325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.060325] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.060325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.060619] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.062027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.062027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.062027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 is going to be updated. [ 916.089070] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.089243] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.089372] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.089646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.089886] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.090176] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.761509] env[65162]: INFO networking_nsxv3.common.synchronization [None req-0fd9cf08-2f54-4713-a2a8-47a0948de9f3 None None] Enqueued Resource ID: 3603c468-408c-4956-9e34-305783d1d726 with Priority: HIGHEST for action port [ 916.764307] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3603c468-408c-4956-9e34-305783d1d726 with Priority: HIGHEST for action port [ 916.764840] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-3603c468-408c-4956-9e34-305783d1d726 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.764998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3603c468-408c-4956-9e34-305783d1d726" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.765139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3603c468-408c-4956-9e34-305783d1d726" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.765406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3603c468-408c-4956-9e34-305783d1d726" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.765668] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3603c468-408c-4956-9e34-305783d1d726',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.852540] env[65162]: INFO networking_nsxv3.common.synchronization [req-8c333ba4-2f7e-4b22-9cdb-ceecc1d44771 req-8062565f-12dd-492f-9dbd-a989192bf09c service nova] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_rules [ 916.852540] env[65162]: INFO networking_nsxv3.common.synchronization [req-8c333ba4-2f7e-4b22-9cdb-ceecc1d44771 req-8062565f-12dd-492f-9dbd-a989192bf09c service nova] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 916.852540] env[65162]: INFO networking_nsxv3.common.synchronization [req-8c333ba4-2f7e-4b22-9cdb-ceecc1d44771 req-8062565f-12dd-492f-9dbd-a989192bf09c service nova] Enqueued Resource ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 with Priority: HIGHEST for action port [ 916.854122] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_rules [ 916.854248] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 916.854385] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 with Priority: HIGHEST for action port [ 916.854633] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.854788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.854873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.855118] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.855204] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.856214] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.856352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.856434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.856611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.856792] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.857686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.857686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.862375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.862375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.862375] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.862375] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f443da1-15c5-47e2-887d-0dcb6d2ea209 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.862375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.862375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.862375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.862375] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f443da1-15c5-47e2-887d-0dcb6d2ea209',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.267678] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3603c468-408c-4956-9e34-305783d1d726 [ 917.267955] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.268139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.268212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.268444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.268530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.268624] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3603c468-408c-4956-9e34-305783d1d726 already deleted. [ 917.268706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3603c468-408c-4956-9e34-305783d1d726" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.363357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.363498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.364887] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.365889] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f443da1-15c5-47e2-887d-0dcb6d2ea209 with status ACTIVE [ 917.366087] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.366202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.366265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.366490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.366575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.366772] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.366888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.366961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.367170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.367252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.367438] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.367533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.367595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.367756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.367842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.367979] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f443da1-15c5-47e2-887d-0dcb6d2ea209 is going to be updated. [ 917.400175] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.400321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.400412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.400630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.400765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.400926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f443da1-15c5-47e2-887d-0dcb6d2ea209" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.870481] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.968468] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 917.968695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.373175] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.373349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.373521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.373648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.373747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.373847] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 918.404569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.404787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.404889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.405204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.405463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.415075] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 918.461715] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b170727e-1106-4307-83a1-f7331b7f6154 None None] Enqueued Resource ID: 71ec5a46-3324-4d7e-a444-96b70780ce61 with Priority: HIGHEST for action port [ 918.461899] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ec5a46-3324-4d7e-a444-96b70780ce61 with Priority: HIGHEST for action port [ 918.466029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ec5a46-3324-4d7e-a444-96b70780ce61 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.466029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ec5a46-3324-4d7e-a444-96b70780ce61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.466029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ec5a46-3324-4d7e-a444-96b70780ce61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.466029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ec5a46-3324-4d7e-a444-96b70780ce61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.466029] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ec5a46-3324-4d7e-a444-96b70780ce61',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.969977] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71ec5a46-3324-4d7e-a444-96b70780ce61 [ 918.970291] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.970469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.970598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.970887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.971034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.971130] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71ec5a46-3324-4d7e-a444-96b70780ce61 already deleted. [ 918.971312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ec5a46-3324-4d7e-a444-96b70780ce61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.429714] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 920.430511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.430893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.431376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.431751] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.432073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.432241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.432670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.432850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.436744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.436744] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.943038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.943211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.943297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.944044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.944582] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.944582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.944729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.944838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.944930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.945282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.945485] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.945590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.945653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.945839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.946122] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.946297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.946362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.946532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.947051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.947051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.947051] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.044837] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.045083] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_members [ 921.046395] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.047074] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_members [ 921.047436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.047643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.047977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.047977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.048229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.048229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.048334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.048525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.048657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.048800] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.049822] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.050110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.050476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.050838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.051060] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.051342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.051454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.052046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.052046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.052046] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.109223] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_rules [ 921.109434] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.109683] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_rules [ 921.109762] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_members [ 921.109880] env[65162]: INFO networking_nsxv3.common.synchronization [req-99630c37-f0de-4eed-a1e7-5c9451bbfca9 req-4d049c15-6a49-4205-99da-9ad4b725aa6d tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 with Priority: HIGHEST for action port [ 921.110709] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_rules [ 921.110792] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_rules [ 921.111056] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 with Priority: HIGHEST for action port [ 921.111056] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.111165] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_members [ 921.111531] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.111708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.111807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.112157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.112194] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.114369] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.114369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.114369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.114369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.114369] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.114997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4fa09be-41e5-42d5-8384-2f7dd920b236 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.115292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.115456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.115800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.115960] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4fa09be-41e5-42d5-8384-2f7dd920b236',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.116960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.117125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.117407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.117818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.452521] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9998726b-c2cc-495a-9b94-43b9da32545d: rpc.has_security_group_logging(os_id): False [ 921.477045] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.477045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.477045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.477045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.499416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.500135] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.500449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.500588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.500870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.500992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.501300] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.501613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.501761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.501981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.502138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.502342] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.502442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.502499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.502651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.502749] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.502819] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 921.553961] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.556602] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.606813] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.607039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.607039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.608312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.608312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.619323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.619450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.619855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.619855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.619974] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4fa09be-41e5-42d5-8384-2f7dd920b236 with status ACTIVE [ 921.620916] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.620916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.620916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.620916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.620916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.620916] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.621128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.621128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.621216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.621294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.621467] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.621560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.621620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.621792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.621873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.621958] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 is going to be updated. [ 921.624342] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 921.646170] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.646367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.646412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.646590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.646765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.646949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.925724] env[65162]: INFO networking_nsxv3.common.synchronization [req-d6dccbeb-ad1d-4ae1-8c73-a2029fc60d70 req-5c9ed248-41b5-4a31-bf9f-ef8a5d1bbf67 tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.925724] env[65162]: INFO networking_nsxv3.common.synchronization [req-d6dccbeb-ad1d-4ae1-8c73-a2029fc60d70 req-5c9ed248-41b5-4a31-bf9f-ef8a5d1bbf67 tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_members [ 921.925724] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.925911] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 with Priority: HIGHEST for action security_group_members [ 921.927361] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.927469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.927755] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.927846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.989021] env[65162]: INFO networking_nsxv3.common.synchronization [req-d6dccbeb-ad1d-4ae1-8c73-a2029fc60d70 req-5c9ed248-41b5-4a31-bf9f-ef8a5d1bbf67 tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_rules [ 921.989300] env[65162]: INFO networking_nsxv3.common.synchronization [req-d6dccbeb-ad1d-4ae1-8c73-a2029fc60d70 req-5c9ed248-41b5-4a31-bf9f-ef8a5d1bbf67 tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.989484] env[65162]: INFO networking_nsxv3.common.synchronization [req-d6dccbeb-ad1d-4ae1-8c73-a2029fc60d70 req-5c9ed248-41b5-4a31-bf9f-ef8a5d1bbf67 tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 with Priority: HIGHEST for action port [ 921.994173] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_rules [ 921.994771] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 921.994912] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 with Priority: HIGHEST for action port [ 921.999305] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.999305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.999305] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.999305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.999305] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4fa09be-41e5-42d5-8384-2f7dd920b236 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.999305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.999305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.999305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.999305] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4fa09be-41e5-42d5-8384-2f7dd920b236',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.059554] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.060796] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.502168] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4fa09be-41e5-42d5-8384-2f7dd920b236 with status ACTIVE [ 922.502614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.502614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.502729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.503079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.503079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.503361] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.503578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.503578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.505190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.505190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.505190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.505190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.505190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.505190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.505190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.505190] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4fa09be-41e5-42d5-8384-2f7dd920b236 is going to be updated. [ 922.538936] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.538936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.538936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.539505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.539505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.539791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4fa09be-41e5-42d5-8384-2f7dd920b236" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.564757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.568262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.568262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.568262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.568262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.568262] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 is going to be created. [ 922.568569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.568863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.569013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.569311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.569577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.569619] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be updated. [ 922.620639] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.623028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.623028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.623028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.623028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.643457] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.643752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.643874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.644258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.644539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.649574] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 in Status: UNINITIALIZED for 2s [ 922.661699] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 922.808346] env[65162]: INFO networking_nsxv3.common.synchronization [None req-234d33b0-e894-4b5b-8ebe-7b3a614abb16 None None] Enqueued Resource ID: c951fd2f-9e63-4726-867f-62b419860d13 with Priority: HIGHEST for action port [ 922.809089] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c951fd2f-9e63-4726-867f-62b419860d13 with Priority: HIGHEST for action port [ 922.809516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c951fd2f-9e63-4726-867f-62b419860d13 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.809729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c951fd2f-9e63-4726-867f-62b419860d13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.809775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c951fd2f-9e63-4726-867f-62b419860d13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.810098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c951fd2f-9e63-4726-867f-62b419860d13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.810187] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c951fd2f-9e63-4726-867f-62b419860d13',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.321777] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c951fd2f-9e63-4726-867f-62b419860d13 [ 923.321777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.322485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.322485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.322485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.322485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.322485] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c951fd2f-9e63-4726-867f-62b419860d13 already deleted. [ 923.322485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c951fd2f-9e63-4726-867f-62b419860d13" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.640032] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 923.640425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.086928] env[65162]: INFO networking_nsxv3.common.synchronization [req-f4f2a06a-732d-4e01-a7d1-1e9060de40d5 req-5bf3c960-90f7-4332-bc01-f2c43b53706f tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 924.087814] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 924.088276] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.088413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.088512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.088781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.089038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.089210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.089303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.089558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.089796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.089917] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.514556] env[65162]: INFO networking_nsxv3.common.synchronization [req-58edc56a-31be-4ab4-b91b-45af227e2f82 req-d2f4bab1-b1ed-453b-b2ac-32d1007f5933 tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 924.515081] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 924.515904] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.516119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.516354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.516477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.516680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.516798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.516855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.517054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.517142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.517237] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.597586] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.662087] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 in Status: SUCCESS [ 924.662588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.663350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.663587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.663769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.663903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.663972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.664718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.664718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.664718] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.675176] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 924.675176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.675176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.675176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.675176] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.675176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.675176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.675176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.675630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.675630] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.019876] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.020144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.020263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.020561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.020711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.021046] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.021219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.021321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.021590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.021732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.021867] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a already deleted. [ 925.022142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.072130] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.072130] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.072130] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.072130] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.072130] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.072130] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.072130] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.072578] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.073184] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.074162] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.074296] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.074414] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.074526] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.074637] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.074746] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.074892] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.101521] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.103744] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.106615] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.106615] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.106615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.106615] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.106615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.106615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.106615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.106615] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.170035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.170035] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.170035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.170035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 is going to be deleted. [ 925.178679] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.222026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.222026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.222026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.222026] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.608669] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.608933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.609066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.609364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.609506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.609669] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 925.611531] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.611842] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.612075] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.612586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.612846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.613114] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 not found, creating... [ 925.613694] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.613958] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.614328] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.614869] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.615140] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.615700] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.615942] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.616527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.616527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.616672] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.616845] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 is going to be created. [ 925.648642] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.648919] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.649031] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.649280] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.649529] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.649764] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.661191] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.661462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.661462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.661946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.661946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.675324] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 925.679864] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.725689] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.725954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.725954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.726361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.726615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.726928] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.727144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.727305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.727360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.727440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.727534] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 already deleted. [ 925.727622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.727761] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.729470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.729738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.729975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.730137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.730235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.730436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.730619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.730857] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.183312] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.183312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.183312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.183560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.183598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.183688] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be updated. [ 926.225151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.225151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.225151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.225151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.225151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.230020] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6a1dbd3-4e75-4206-b3d4-49776e6b2a16',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.235654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.235654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.235654] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 already deleted. [ 926.235654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.238500] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 926.410705] env[65162]: INFO networking_nsxv3.common.synchronization [req-58edc56a-31be-4ab4-b91b-45af227e2f82 req-76793078-b797-46cf-b277-240f5b74f052 service nova] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 926.410983] env[65162]: INFO networking_nsxv3.common.synchronization [req-58edc56a-31be-4ab4-b91b-45af227e2f82 req-76793078-b797-46cf-b277-240f5b74f052 service nova] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 926.412765] env[65162]: INFO networking_nsxv3.common.synchronization [req-58edc56a-31be-4ab4-b91b-45af227e2f82 req-76793078-b797-46cf-b277-240f5b74f052 service nova] Enqueued Resource ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 with Priority: HIGHEST for action port [ 926.413485] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 926.413637] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 926.413733] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 with Priority: HIGHEST for action port [ 926.414048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.414180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.414380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.414530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.414530] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.415475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.415606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.415657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.415837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.415989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.416190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.416264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.416464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.416557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.416656] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.417518] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.417632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.417716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.417856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.417932] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.732598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6a1dbd3-4e75-4206-b3d4-49776e6b2a16: rpc.has_security_group_logging(os_id): False [ 926.760514] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.760671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.760773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.761067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.761206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.761600] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.761600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.761755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.762026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.762026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.762126] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 is going to be created. [ 926.789206] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16], does not exist path=[/infra/domains/default/groups/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16]."\n}' [ 926.790323] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 [ 926.790323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 926.841183] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.841406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.841484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.842202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.843768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.844454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.844454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.844454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.844731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.844783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.845687] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.845687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.845687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.845687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.845687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.845687] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 is going to be created. [ 926.869626] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16], does not exist path=[/infra/domains/default/groups/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 [ 926.870102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6a1dbd3-4e75-4206-b3d4-49776e6b2a16" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.873709] env[65162]: Traceback (most recent call last): [ 926.873709] env[65162]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 926.873709] env[65162]: return func(*args, **kwargs) [ 926.873709] env[65162]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 926.873709] env[65162]: res.raise_for_status() [ 926.873709] env[65162]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 926.873709] env[65162]: raise HTTPError(http_error_msg, response=self) [ 926.873709] env[65162]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 [ 926.873709] env[65162]: During handling of the above exception, another exception occurred: [ 926.873709] env[65162]: Traceback (most recent call last): [ 926.873709] env[65162]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 926.873709] env[65162]: listener.cb(fileno) [ 926.873709] env[65162]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 926.873709] env[65162]: result = function(*args, **kwargs) [ 926.873709] env[65162]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 926.873709] env[65162]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 926.873709] env[65162]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 926.873709] env[65162]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 926.873709] env[65162]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 926.873709] env[65162]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 926.873709] env[65162]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 926.873709] env[65162]: res.raise_for_status() [ 926.873709] env[65162]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 926.873709] env[65162]: raise HTTPError(http_error_msg, response=self) [ 926.873709] env[65162]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d6a1dbd3-4e75-4206-b3d4-49776e6b2a16 [ 926.873709] env[65162]: Removing descriptor: 56 [ 926.920088] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.920278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.920577] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.921680] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 with status ACTIVE [ 926.921989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.922182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.922270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.922544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.922858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.926149] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.927123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.927358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.928467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.928648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.929327] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.930217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.930596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.931135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.931135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.931322] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 is going to be updated. [ 926.958439] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.958677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.958763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.958980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.959217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.959420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.207466] env[65162]: INFO networking_nsxv3.common.synchronization [req-a6fb9783-bf89-44a8-a660-a6e38a833a23 req-1da027e6-c1c0-4d57-8a26-4f24c6611f17 tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 927.211910] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 927.212370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.212370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.212466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.214111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.214111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.214111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.214111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.214111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.214111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.214111] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.434411] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.656108] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.656321] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.656461] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.656731] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.656998] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.658205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.658331] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.658645] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.658744] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.658915] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.659135] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.659250] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.659355] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.659466] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.659561] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.659719] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.682470] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.682644] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.682788] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.682933] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.683349] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-eec61085-f1e7-4463-849f-091ea556e45f taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.683553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.683677] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.684036] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.684180] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eec61085-f1e7-4463-849f-091ea556e45f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.685818] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 927.686034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.720462] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.853933] env[65162]: INFO networking_nsxv3.common.synchronization [None req-7882e7cb-c756-43be-bd07-0d7d5de708f0 None None] Enqueued Resource ID: 96003038-b752-4ae4-8329-0f01717972ee with Priority: HIGHEST for action port [ 927.854478] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96003038-b752-4ae4-8329-0f01717972ee with Priority: HIGHEST for action port [ 927.854873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-96003038-b752-4ae4-8329-0f01717972ee taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.855037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96003038-b752-4ae4-8329-0f01717972ee" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.855037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96003038-b752-4ae4-8329-0f01717972ee" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.855608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96003038-b752-4ae4-8329-0f01717972ee" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.855736] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96003038-b752-4ae4-8329-0f01717972ee',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.940868] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.941087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.941087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.941501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.941620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.941764] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a is going to be created. [ 927.972473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.972697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.972766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.972978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.973472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.987325] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: UNINITIALIZED for 2s [ 928.187451] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.188617] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.188617] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.188792] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.188838] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.188990] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port eec61085-f1e7-4463-849f-091ea556e45f not found, creating... [ 928.189284] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.189472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.189599] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.189835] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.189973] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.190374] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.190543] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.190661] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.190880] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.191070] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.191248] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: eec61085-f1e7-4463-849f-091ea556e45f is going to be created. [ 928.217683] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.217961] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.218109] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.218417] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.218690] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.218939] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.222745] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.249479] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 928.249716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.250331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.250570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.250775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.250903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.250952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.251133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.251207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.251307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.251398] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.253396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.253730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.254594] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.254699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.254790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.254964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.255071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.255215] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.359990] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96003038-b752-4ae4-8329-0f01717972ee [ 928.360658] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.360658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.360658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.360868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.361205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.361205] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96003038-b752-4ae4-8329-0f01717972ee already deleted. [ 928.361205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96003038-b752-4ae4-8329-0f01717972ee" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.518451] env[65162]: INFO networking_nsxv3.common.synchronization [None req-0e0f2386-cdc8-4de8-a0b8-72d3ab0b2749 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_rules [ 928.519374] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_rules [ 928.520377] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.520377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.520377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.520648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.520714] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.709658] env[65162]: INFO networking_nsxv3.common.synchronization [None req-295ca706-d588-461a-87b0-0a8899bc4d40 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_rules [ 928.710180] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_rules [ 928.710879] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.710879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.726223] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.726223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.726223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.726223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.726480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.726480] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 928.755189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.755189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.758010] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.774042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.774042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.774042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.774042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.774042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.790378] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 929.055634] env[65162]: INFO networking_nsxv3.common.synchronization [req-a6fb9783-bf89-44a8-a660-a6e38a833a23 req-eaa7c9c1-94fb-4154-9513-c5db003ca6f5 service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 929.059187] env[65162]: INFO networking_nsxv3.common.synchronization [req-a6fb9783-bf89-44a8-a660-a6e38a833a23 req-eaa7c9c1-94fb-4154-9513-c5db003ca6f5 service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 929.063028] env[65162]: INFO networking_nsxv3.common.synchronization [req-a6fb9783-bf89-44a8-a660-a6e38a833a23 req-eaa7c9c1-94fb-4154-9513-c5db003ca6f5 service nova] Enqueued Resource ID: eec61085-f1e7-4463-849f-091ea556e45f with Priority: HIGHEST for action port [ 929.063028] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.063028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 already deleted. [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.063028] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 929.063028] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 929.063028] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eec61085-f1e7-4463-849f-091ea556e45f with Priority: HIGHEST for action port [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.063028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.063028] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.064476] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.064476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.064476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.064476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.064476] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.065928] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.066075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.066259] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-eec61085-f1e7-4463-849f-091ea556e45f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.066379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.066460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.068299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.068625] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eec61085-f1e7-4463-849f-091ea556e45f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.260977] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.570750] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.570901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.572145] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eec61085-f1e7-4463-849f-091ea556e45f with status ACTIVE [ 929.572439] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.572537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.572571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.572771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.572863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.573085] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.573179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.573248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.573507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.573615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.573816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.573938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.574007] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.574173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.574263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.574348] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eec61085-f1e7-4463-849f-091ea556e45f is going to be updated. [ 929.598374] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.598574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.598641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.598884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.598980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.599446] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 already deleted. [ 929.599446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.600936] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.603277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.603277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.603277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.603277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.603277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eec61085-f1e7-4463-849f-091ea556e45f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.761294] env[65162]: INFO networking_nsxv3.common.synchronization [req-b2d6aa6f-f0ae-4297-a2e5-56077f1ef781 req-1eff1d94-8cc8-4224-b572-2fe86a06ac71 tempest-ServersTestJSON-1771662425 tempest-ServersTestJSON-1771662425-project-member] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_members [ 929.761294] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_members [ 929.761294] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.763078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.763325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.763691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.765299] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.765618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.765868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.766166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.766353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.766561] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.769085] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.771424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.771424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.771424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.771424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.771424] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be updated. [ 929.812499] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.812886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.813764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.814529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.814886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.831123] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 930.001464] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: SUCCESS [ 930.001763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.002048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.002336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.002551] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.002714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.002851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.003088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.003205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.003359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.003471] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.211868] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.211868] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.211868] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.211868] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.213483] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.213483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.213483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.213483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.213483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.213483] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.213805] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.214165] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.214165] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.214165] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.214330] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.214702] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.244774] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.244951] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.248024] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.248024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.248024] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-95190aa0-422e-4b36-a49b-4ca14659811b taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.248024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.248024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.248024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.248024] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95190aa0-422e-4b36-a49b-4ca14659811b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.271896] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.272155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.272155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.272327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.272583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.272842] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.273586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.273586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.273586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.273586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.273586] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 already deleted. [ 930.273586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.506308] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.683676] env[65162]: INFO networking_nsxv3.common.synchronization [None req-04bd9c7c-0dc5-411a-a43f-2bdf8b5acca0 None None] Enqueued Resource ID: 0576b0fc-8372-40a6-a2a7-1dcde4514bff with Priority: HIGHEST for action port [ 930.684231] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0576b0fc-8372-40a6-a2a7-1dcde4514bff with Priority: HIGHEST for action port [ 930.684531] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0576b0fc-8372-40a6-a2a7-1dcde4514bff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.684657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0576b0fc-8372-40a6-a2a7-1dcde4514bff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.684726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0576b0fc-8372-40a6-a2a7-1dcde4514bff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.684985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0576b0fc-8372-40a6-a2a7-1dcde4514bff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.685168] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0576b0fc-8372-40a6-a2a7-1dcde4514bff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.750930] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.750930] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.751242] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.751242] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.751520] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.751626] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 95190aa0-422e-4b36-a49b-4ca14659811b not found, creating... [ 930.752102] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.752102] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.752102] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.752318] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.752430] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.752705] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.752855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.752967] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.753358] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.753449] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.753625] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 95190aa0-422e-4b36-a49b-4ca14659811b is going to be created. [ 930.776891] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.777118] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.777228] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.777699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.777944] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.778200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.801992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.801992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.801992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.801992] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.010477] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a29ad06f-d3bc-443d-9727-1f7cc59ff50a: rpc.has_security_group_logging(os_id): False [ 931.033738] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.033877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.033953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.034226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.034311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.034569] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.034671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.034747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.034922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.035031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.035104] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a is going to be created. [ 931.108443] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.108611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.108733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.108986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.109230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.128925] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: IN_PROGRESS for 2s [ 931.188489] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0576b0fc-8372-40a6-a2a7-1dcde4514bff [ 931.188489] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.188489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.189426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.189426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.189426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.189426] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0576b0fc-8372-40a6-a2a7-1dcde4514bff already deleted. [ 931.189426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0576b0fc-8372-40a6-a2a7-1dcde4514bff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.307685] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.539415] env[65162]: INFO networking_nsxv3.common.synchronization [req-b2d6aa6f-f0ae-4297-a2e5-56077f1ef781 req-4c82386e-c2a9-4583-806a-86d58d398159 service nova] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_rules [ 931.539481] env[65162]: INFO networking_nsxv3.common.synchronization [req-b2d6aa6f-f0ae-4297-a2e5-56077f1ef781 req-4c82386e-c2a9-4583-806a-86d58d398159 service nova] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_members [ 931.539878] env[65162]: INFO networking_nsxv3.common.synchronization [req-b2d6aa6f-f0ae-4297-a2e5-56077f1ef781 req-4c82386e-c2a9-4583-806a-86d58d398159 service nova] Enqueued Resource ID: 95190aa0-422e-4b36-a49b-4ca14659811b with Priority: HIGHEST for action port [ 931.542104] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_rules [ 931.542364] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_members [ 931.542443] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95190aa0-422e-4b36-a49b-4ca14659811b with Priority: HIGHEST for action port [ 931.542806] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.542937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.543036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.543364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.543545] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.547407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.547647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.547741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.547962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.548199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.548352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.548463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.548597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.548710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.548827] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.549998] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-95190aa0-422e-4b36-a49b-4ca14659811b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.552210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.554205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.554460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.554560] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95190aa0-422e-4b36-a49b-4ca14659811b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.809707] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.846286] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 931.846652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.847301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.847410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.847598] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.847736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.847811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.847958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.848050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.848145] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.013580] env[65162]: INFO networking_nsxv3.common.synchronization [req-da376ea3-6eb1-4502-a455-1e267d34446b req-a38bc7e4-f271-491b-b5f6-7d4d43f3d3f0 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 932.014121] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 932.014871] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.014871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.015040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.015283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.015521] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.015629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.015691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.015950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.016052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.016164] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.057185] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.058314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.058565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.059382] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95190aa0-422e-4b36-a49b-4ca14659811b with status ACTIVE [ 932.059712] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.059857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.059933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.060187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.060247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.060629] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.060751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.060835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.061051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.061155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.061391] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.061499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.061574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.061723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.061910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.061910] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95190aa0-422e-4b36-a49b-4ca14659811b is going to be updated. [ 932.089516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.089720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.089720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.090015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.090178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.097162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95190aa0-422e-4b36-a49b-4ca14659811b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.314137] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.314137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.314137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.314137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.316580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.316580] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 932.348480] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.348480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.348480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.348480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.348480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.352482] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.357250] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 932.505034] env[65162]: INFO networking_nsxv3.common.synchronization [req-27e382bf-7afd-40dd-9db8-0e230d050729 req-3bb85d4e-ba21-4f8b-9d47-de3a01032ffb tempest-AttachInterfacesV270Test-141058768 tempest-AttachInterfacesV270Test-141058768-project-member] Enqueued Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_members [ 932.505497] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_members [ 932.506082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.506082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.506236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.506442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.506600] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.506716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.511445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.511445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.511445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.511445] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.520372] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.520372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.520372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.520372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.543730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.543730] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.543730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.543730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.543730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.543730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.543730] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 932.560147] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.582525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.582525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.582525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.582525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.582759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.595948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 932.856266] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.011130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.011364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.011474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.011737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.011869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.012156] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.012278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.012376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.012583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.012717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.012820] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c already deleted. [ 933.012937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.025738] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-575 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.025993] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-575" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.026152] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-575" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.026541] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-575" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.026838] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.027044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.027172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.027429] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.027574] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.027798] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.027919] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.028066] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.028280] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.028424] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.028535] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.028698] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.050043] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.050043] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 933.050043] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.051239] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-575" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.051239] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-f26bf212-6a22-43a9-9a56-6659b12dc556 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.051239] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.051239] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.051239] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.051615] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f26bf212-6a22-43a9-9a56-6659b12dc556',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.062258] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.062464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.062544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.062772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.062855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.062949] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 is going to be created. [ 933.096018] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.096018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.096018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.096018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.096018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.109287] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a35add5-dafe-4fde-989e-70f334050fa8 in Status: UNINITIALIZED for 2s [ 933.141597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: SUCCESS [ 933.142165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.362936] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.362936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.362936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.362936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.362936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.362936] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be updated. [ 933.400024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.400024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.400024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.400024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.400024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.415717] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 933.555097] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.555097] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.555097] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.555537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.555730] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.555917] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port f26bf212-6a22-43a9-9a56-6659b12dc556 not found, creating... [ 933.556231] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.556389] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.556518] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.556744] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.558038] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.558038] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.558038] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.558038] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.558038] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.558038] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.558038] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: f26bf212-6a22-43a9-9a56-6659b12dc556 is going to be created. [ 933.584740] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.585030] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.586629] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.587306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.587610] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.587918] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.279782] env[65162]: INFO networking_nsxv3.common.synchronization [req-27e382bf-7afd-40dd-9db8-0e230d050729 req-36e818e1-d3ff-47bb-9b4c-eed860d8d764 service nova] Enqueued Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_rules [ 934.279956] env[65162]: INFO networking_nsxv3.common.synchronization [req-27e382bf-7afd-40dd-9db8-0e230d050729 req-36e818e1-d3ff-47bb-9b4c-eed860d8d764 service nova] Enqueued Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_members [ 934.280113] env[65162]: INFO networking_nsxv3.common.synchronization [req-27e382bf-7afd-40dd-9db8-0e230d050729 req-36e818e1-d3ff-47bb-9b4c-eed860d8d764 service nova] Enqueued Resource ID: f26bf212-6a22-43a9-9a56-6659b12dc556 with Priority: HIGHEST for action port [ 934.280810] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_rules [ 934.281019] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_members [ 934.289045] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f26bf212-6a22-43a9-9a56-6659b12dc556 with Priority: HIGHEST for action port [ 934.289045] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.289045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.289045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.289045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.289045] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.289538] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.289538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.289538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.289538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.289824] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.289824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.289824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.290036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.291297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.291297] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.291297] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f26bf212-6a22-43a9-9a56-6659b12dc556 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.291297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.291297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.291689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.291689] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f26bf212-6a22-43a9-9a56-6659b12dc556',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.368762] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 934.369121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.369310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.369405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.369589] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.369728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.369801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.369967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.370060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.370149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.370255] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.607193] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 934.608189] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 934.608374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.794642] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.794815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.795594] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.796206] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f26bf212-6a22-43a9-9a56-6659b12dc556 with status ACTIVE [ 934.796305] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.796419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.796583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.796742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.797205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.797205] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.797205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.797205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.797401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.797401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.797825] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.797825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.797825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.797995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.798041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.798138] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f26bf212-6a22-43a9-9a56-6659b12dc556 is going to be updated. [ 934.822474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.822684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.822684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.822905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.823065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.824773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f26bf212-6a22-43a9-9a56-6659b12dc556" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.872966] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.873253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.873388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.873763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.874073] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.874295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.874455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.874687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.874848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.875014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.875310] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.875551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.875713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.875983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.876238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.876398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.876518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.876708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.876861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.877014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.877186] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.121070] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a35add5-dafe-4fde-989e-70f334050fa8 in Status: SUCCESS [ 935.121070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.121070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.121391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.121578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.121719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.121851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.122153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.122153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.122244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.122334] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.300579] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.307577] env[65162]: INFO networking_nsxv3.common.synchronization [req-cc13562e-d33b-48e5-bcf9-2ca287f8ee6d req-8fca5cd6-6c04-4e94-8422-b662a02b6a6a tempest-ServerAddressesTestJSON-870171362 tempest-ServerAddressesTestJSON-870171362-project-member] Enqueued Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_members [ 935.308255] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_members [ 935.309246] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.309376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.309450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.309734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.309944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.310076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.310165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.310654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.310753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.310995] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.380713] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55eb5d3-a252-4f36-9046-1505d8f8fa4e: rpc.has_security_group_logging(os_id): False [ 935.404636] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.405539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.405539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.405539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.428024] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.428024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.428024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.428896] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.429203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.429368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.429607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.429951] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.430310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.430480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.430759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.434019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.434019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.434019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.436315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.436718] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.436974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.437143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.437644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.437943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.438307] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.438881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.440816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.440816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.440816] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 935.578434] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.578434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.578434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.578434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.578434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.601034] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 935.624394] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.808085] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.808401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.808641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.809044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.809237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.811021] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c is going to be created. [ 935.812684] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-818 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.812866] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-818" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.813443] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-818" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.813443] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-818" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.813608] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.813775] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.814175] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.814229] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.814672] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.814753] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.814874] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.814988] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.815142] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.815383] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.815837] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.815837] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.817445] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.817604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.817746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.817836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.817983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.818156] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.818263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.818263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.818404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.818476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.818559] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caef476-012f-4313-ac05-e9388bfdc717 already deleted. [ 935.818639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.840910] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.841389] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.841501] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.841691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-818" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.842051] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-60768139-6aea-4854-a8cb-d97e8fb3491a taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.842290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.842290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.842636] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.842758] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60768139-6aea-4854-a8cb-d97e8fb3491a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.854096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.854420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.854420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.854682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.854905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.867792] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c in Status: UNINITIALIZED for 2s [ 935.944892] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd58f15a-fa3c-491e-8e2b-378722a4cea1: rpc.has_security_group_logging(os_id): False [ 935.966378] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.966378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.966846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.966846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.992514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.992961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.993133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.993133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.993311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.993423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.993714] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.993837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.993987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.996804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.996983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.997325] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.997449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.997520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.997717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.997854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.997992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be updated. [ 936.092728] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.093017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.093017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.093126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.093301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.110322] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 936.127519] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a35add5-dafe-4fde-989e-70f334050fa8: rpc.has_security_group_logging(os_id): False [ 936.151735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.151735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.151735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.151735] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 is going to be created. [ 936.248406] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.248621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.248621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.248765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.249047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.262760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a35add5-dafe-4fde-989e-70f334050fa8 in Status: IN_PROGRESS for 2s [ 936.345610] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.346689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.346689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.346689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.346689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.346983] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 60768139-6aea-4854-a8cb-d97e8fb3491a not found, creating... [ 936.347475] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.347715] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.347846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.348420] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.348639] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.349159] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.349411] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.349598] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.349917] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.350098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.350379] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 60768139-6aea-4854-a8cb-d97e8fb3491a is going to be created. [ 936.379733] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.380029] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.380232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.381025] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.381025] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.381399] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.620428] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 937.620783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.626830] env[65162]: INFO networking_nsxv3.common.synchronization [req-cc13562e-d33b-48e5-bcf9-2ca287f8ee6d req-86e269bd-dcfb-4d11-a6a1-ef2d3b04d6b5 service nova] Enqueued Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_rules [ 937.626830] env[65162]: INFO networking_nsxv3.common.synchronization [req-cc13562e-d33b-48e5-bcf9-2ca287f8ee6d req-86e269bd-dcfb-4d11-a6a1-ef2d3b04d6b5 service nova] Enqueued Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_members [ 937.626920] env[65162]: INFO networking_nsxv3.common.synchronization [req-cc13562e-d33b-48e5-bcf9-2ca287f8ee6d req-86e269bd-dcfb-4d11-a6a1-ef2d3b04d6b5 service nova] Enqueued Resource ID: 60768139-6aea-4854-a8cb-d97e8fb3491a with Priority: HIGHEST for action port [ 937.627467] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_rules [ 937.627605] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_members [ 937.627704] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60768139-6aea-4854-a8cb-d97e8fb3491a with Priority: HIGHEST for action port [ 937.627983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.632202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.632284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.632570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.632660] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.635032] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.635211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.635308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.635444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.635642] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.635752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.635851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.636247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.636247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.636457] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.643738] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-60768139-6aea-4854-a8cb-d97e8fb3491a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.643738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.643738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.643738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.643738] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60768139-6aea-4854-a8cb-d97e8fb3491a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.886911] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c in Status: SUCCESS [ 937.886911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.886911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.887232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.887337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.887461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.887524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.887684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.887775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.887968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.888079] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.041970] env[65162]: INFO networking_nsxv3.common.synchronization [req-96c992ba-8efc-4bf0-ae1b-7dc063680457 req-22cb32e3-0c68-4648-ab83-ae96856f6dac tempest-ServerRescueTestJSONUnderV235-465158692 tempest-ServerRescueTestJSONUnderV235-465158692-project-member] Enqueued Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 938.042569] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 with Priority: HIGHEST for action security_group_members [ 938.042894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd58f15a-fa3c-491e-8e2b-378722a4cea1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.044167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.044318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.044535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.044734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.044824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.044880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.045049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.045141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.045240] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.134514] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 938.134765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.135245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.135378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.135459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.135765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.135846] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd58f15a-fa3c-491e-8e2b-378722a4cea1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.139371] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.145949] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60768139-6aea-4854-a8cb-d97e8fb3491a with status ACTIVE [ 938.146240] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.146414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.146483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.147050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.147050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.147050] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.147401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.147401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.147401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.147552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.147677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.147784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.147784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.150643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.150643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.150643] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60768139-6aea-4854-a8cb-d97e8fb3491a is going to be updated. [ 938.181116] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.181314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.181366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.181548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.181683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.181859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60768139-6aea-4854-a8cb-d97e8fb3491a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.282018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a35add5-dafe-4fde-989e-70f334050fa8 in Status: SUCCESS [ 938.282354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.391359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.391650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.391650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.392702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.392702] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.392702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.392702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.392702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.392702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.392702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.392702] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.393453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.393453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.393453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.393578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.393785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.393924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.394839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.395170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.395451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.395605] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.548192] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.548413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.548413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.548733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.548733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.549970] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.550111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.550174] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.550734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.550734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.550734] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be updated. [ 938.592221] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.592429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.592508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.594101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.594101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.611613] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: IN_PROGRESS for 2s [ 938.641450] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.662100] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.662687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.662687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.662769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.662904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.663070] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 is going to be deleted. [ 938.755043] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.755693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.755693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.755693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.755868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.755961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.898415] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d4deebf-95e4-4bfd-963f-b8c408668b1c: rpc.has_security_group_logging(os_id): False [ 938.924138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.924138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.924138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.924138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.924734] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.925243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.926137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.926384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.926497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.926579] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c is going to be created. [ 939.023228] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.023588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.023734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.024077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.024322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.042550] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c in Status: IN_PROGRESS for 2s [ 939.144912] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.145085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.145162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.147029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.147029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.147029] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caef476-012f-4313-ac05-e9388bfdc717 is going to be created. [ 939.196041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.196243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.196336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.196761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.196900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.215860] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: UNINITIALIZED for 2s [ 940.425435] env[65162]: INFO networking_nsxv3.common.synchronization [req-f481f80a-eae3-48ee-8883-9049e8dae2c0 req-3783d228-aca4-4f6b-af24-5d5632435fe5 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 940.425942] env[65162]: INFO networking_nsxv3.common.synchronization [req-f481f80a-eae3-48ee-8883-9049e8dae2c0 req-3783d228-aca4-4f6b-af24-5d5632435fe5 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_members [ 940.425942] env[65162]: INFO networking_nsxv3.common.synchronization [req-f481f80a-eae3-48ee-8883-9049e8dae2c0 req-3783d228-aca4-4f6b-af24-5d5632435fe5 tempest-SecurityGroupsTestJSON-2096605137 tempest-SecurityGroupsTestJSON-2096605137-project-member] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 940.428331] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGHEST for action security_group_members [ 940.428547] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGHEST for action security_group_members [ 940.428657] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGHEST for action security_group_members [ 940.429030] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.429306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.429399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.429571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.429788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.429883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.429943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.430192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.432067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.432209] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.433492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fc90dd-4523-40bd-978d-d9bf1437468c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.433631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.433708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.435789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.436109] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.436261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.436370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.436603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.436706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.436811] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.437921] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.438885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.440424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.440424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.441172] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.441172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.441172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.441172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.441172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.441401] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.629371] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 in Status: SUCCESS [ 940.629371] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd58f15a-fa3c-491e-8e2b-378722a4cea1 deletion is rescheduled due to dependency. [ 940.629371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd58f15a-fa3c-491e-8e2b-378722a4cea1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.943283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.943453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.943511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.943721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.945122] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.945122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.945319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.945399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.969650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.970037] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.970153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.970153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.970350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.971080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.971080] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be updated. [ 940.971746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.971950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.990422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.991206] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.991206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.991206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.991446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.991593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.991725] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fc90dd-4523-40bd-978d-d9bf1437468c is going to be updated. [ 940.993103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.993346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.003051] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.003235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.003275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.003486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.003630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.097201] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: IN_PROGRESS for 2s [ 941.097975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.098227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.098347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.098412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.098610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.099826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.099826] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be updated. [ 941.103832] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c in Status: SUCCESS [ 941.103996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.110194] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.110335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.110400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.110592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.110747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.120878] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: IN_PROGRESS for 2s [ 941.135825] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.138276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.138276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.138276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.138276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.148607] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: IN_PROGRESS for 2s [ 941.229041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: UNINITIALIZED for 4s [ 943.108310] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 in Status: SUCCESS [ 943.108616] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 deletion is rescheduled due to dependency. [ 943.108652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.137225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fc90dd-4523-40bd-978d-d9bf1437468c in Status: SUCCESS [ 943.137470] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fc90dd-4523-40bd-978d-d9bf1437468c deletion is rescheduled due to dependency. [ 943.137533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.157381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f in Status: SUCCESS [ 943.157381] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f deletion is rescheduled due to dependency. [ 943.157640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.239845] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: SUCCESS [ 943.240109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.240359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.240592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.240786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.240910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.240976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.241143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.241256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.241358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.241454] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.744739] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.744739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.744739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.744978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.744978] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.745138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.745201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.745320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.745442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.745670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.745920] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.746047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.746119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.746281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.746424] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.746590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.746629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.746779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.746865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.746952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.747061] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.879074] env[65162]: INFO networking_nsxv3.common.synchronization [req-6c1256df-751d-4330-95ea-862abd6405ee req-cc647879-6661-45a8-9cde-bd2ff63e0d02 tempest-ServerAddressesNegativeTestJSON-2018635249 tempest-ServerAddressesNegativeTestJSON-2018635249-project-member] Enqueued Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_members [ 943.879863] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_members [ 943.881103] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.881305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.881429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.881701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.881881] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.881994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.882075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.882240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.882332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.882429] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.220076] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.220483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-855" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.220686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-855" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.220984] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-855" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.221530] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.221811] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.222056] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.222378] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.222614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.223115] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.223337] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.223643] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.223897] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.224124] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.224365] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.224592] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.246581] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.246753] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.246887] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.247073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-855" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.247392] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-5541afcd-9ff1-44d9-83e1-4931523442f1 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.247563] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.247680] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.247989] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.248138] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5541afcd-9ff1-44d9-83e1-4931523442f1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.249033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caef476-012f-4313-ac05-e9388bfdc717: rpc.has_security_group_logging(os_id): False [ 944.266052] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.266187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.266230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.266399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.266484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.267889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.267889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.267889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.267889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.268535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.268535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.268535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.268535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.268535] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caef476-012f-4313-ac05-e9388bfdc717 is going to be created. [ 944.342792] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.342960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.343015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.343217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.343395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.355251] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: IN_PROGRESS for 2s [ 944.385454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.385619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.385713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.385935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.386057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.386312] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.386422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.386485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.386698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.386784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.386871] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 already deleted. [ 944.386992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.752306] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.752595] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.752779] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.753119] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.753314] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.753554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 5541afcd-9ff1-44d9-83e1-4931523442f1 not found, creating... [ 944.753908] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.754140] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.754307] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.754605] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.754784] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.755251] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.755523] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.755726] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.755997] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.756372] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.756598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 5541afcd-9ff1-44d9-83e1-4931523442f1 is going to be created. [ 944.785011] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.785272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.785357] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.785732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.785974] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.786257] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.510422] env[65162]: INFO networking_nsxv3.common.synchronization [req-6c1256df-751d-4330-95ea-862abd6405ee req-9ad71be7-09e1-4fa5-9c92-616745cf238e service nova] Enqueued Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_rules [ 945.510749] env[65162]: INFO networking_nsxv3.common.synchronization [req-6c1256df-751d-4330-95ea-862abd6405ee req-9ad71be7-09e1-4fa5-9c92-616745cf238e service nova] Enqueued Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_members [ 945.510749] env[65162]: INFO networking_nsxv3.common.synchronization [req-6c1256df-751d-4330-95ea-862abd6405ee req-9ad71be7-09e1-4fa5-9c92-616745cf238e service nova] Enqueued Resource ID: 5541afcd-9ff1-44d9-83e1-4931523442f1 with Priority: HIGHEST for action port [ 945.511564] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_rules [ 945.511796] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_members [ 945.511940] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5541afcd-9ff1-44d9-83e1-4931523442f1 with Priority: HIGHEST for action port [ 945.512349] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.512735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.512735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.512967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.513097] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.514140] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.514276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.514347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.514595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.514833] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.514977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.517454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.518108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.518193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.518260] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.519434] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5541afcd-9ff1-44d9-83e1-4931523442f1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.519590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.519712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.519867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.520046] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5541afcd-9ff1-44d9-83e1-4931523442f1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.024254] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.025689] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.025976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.026211] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5541afcd-9ff1-44d9-83e1-4931523442f1 with status ACTIVE [ 946.026385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.026500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.026601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.026886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.026994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.028202] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.028442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.030485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.030741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.030857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.031155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.031275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.031358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.031615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.031719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.031823] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5541afcd-9ff1-44d9-83e1-4931523442f1 is going to be updated. [ 946.074105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.074105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.074105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.074105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.074105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.074312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5541afcd-9ff1-44d9-83e1-4931523442f1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.369133] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: SUCCESS [ 946.369388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.520187] env[65162]: INFO networking_nsxv3.common.synchronization [req-5e45f70a-b19c-4ec3-a6b0-2f8e8585f1ce req-4fe0462b-8473-4ec2-805a-59c453d1b766 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 946.521048] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 946.521048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.521248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.521248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.521492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.522155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.522155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.522155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.522155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.522155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.522463] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.534376] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.953631] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.953818] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.953941] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.954222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.954476] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.954630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.954744] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.954949] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.955324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.955545] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.955697] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.955824] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.955937] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.956057] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.956160] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.956288] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.979031] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.979031] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.979031] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.979031] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.979031] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.979031] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.979031] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.979031] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.979031] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d673ec-4bb7-460b-9e7b-c59223a00fd8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.024831] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.025058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.025106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.025343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.025468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.025780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.025889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.026013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.026138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.026220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.026309] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 947.039402] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.039556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.039626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.039819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.039918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.040074] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 is going to be created. [ 947.061464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.061686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.061743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.062063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.062259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.068089] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.068291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.069801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.069801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.069801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.073447] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 947.078916] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 in Status: UNINITIALIZED for 2s [ 947.480619] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.480979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.481129] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.481536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.481758] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.481987] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port d9d673ec-4bb7-460b-9e7b-c59223a00fd8 not found, creating... [ 947.482435] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.482642] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.482822] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.483167] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.483373] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.483843] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.484089] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.484259] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.484612] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.484844] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.485039] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: d9d673ec-4bb7-460b-9e7b-c59223a00fd8 is going to be created. [ 947.515391] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.515727] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.516030] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.516156] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.516392] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.516648] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.098297] env[65162]: INFO networking_nsxv3.common.synchronization [req-9263b0d7-85e0-4922-80ab-57e17d5ac74c req-9339d9ec-0132-44b1-b3ce-11614240bcdc tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_members [ 948.098919] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGHEST for action security_group_members [ 948.099527] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.099760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.099885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.100165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.100502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.100678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.100813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.101075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.101251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.101403] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.272567] env[65162]: INFO networking_nsxv3.common.synchronization [req-5e45f70a-b19c-4ec3-a6b0-2f8e8585f1ce req-f4245cc7-d3b8-455d-8e84-5c214781f9f8 service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 948.272567] env[65162]: INFO networking_nsxv3.common.synchronization [req-5e45f70a-b19c-4ec3-a6b0-2f8e8585f1ce req-f4245cc7-d3b8-455d-8e84-5c214781f9f8 service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 948.272567] env[65162]: INFO networking_nsxv3.common.synchronization [req-5e45f70a-b19c-4ec3-a6b0-2f8e8585f1ce req-f4245cc7-d3b8-455d-8e84-5c214781f9f8 service nova] Enqueued Resource ID: d9d673ec-4bb7-460b-9e7b-c59223a00fd8 with Priority: HIGHEST for action port [ 948.272843] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 948.273090] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 948.274044] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d673ec-4bb7-460b-9e7b-c59223a00fd8 with Priority: HIGHEST for action port [ 948.274455] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.274622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.274699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.274906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.275639] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.276756] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.276756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.276938] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.277053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.277116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.277351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.277482] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d673ec-4bb7-460b-9e7b-c59223a00fd8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.604506] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.604684] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.604831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.604970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.628994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.629274] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.629388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.629456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.629648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.629732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.629819] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb is going to be updated. [ 948.660716] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.660716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.660974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.661029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.663072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.672564] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb in Status: IN_PROGRESS for 2s [ 948.784645] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.784854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.785184] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9d673ec-4bb7-460b-9e7b-c59223a00fd8 with status ACTIVE [ 948.785443] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.785659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.785763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.786101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.786252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.786400] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.786498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.786611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.786847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.786942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.787189] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.787292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.787375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.787524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.787596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.787703] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9d673ec-4bb7-460b-9e7b-c59223a00fd8 is going to be updated. [ 948.814774] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.814774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.814774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.814774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.814774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.814774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9d673ec-4bb7-460b-9e7b-c59223a00fd8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.085125] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 949.085324] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 949.085468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.085658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.085877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.086093] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.086402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.086402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.086586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.086586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.086586] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.088169] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 in Status: SUCCESS [ 949.088370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.088518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.088727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.088912] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.089090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.089090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.089272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.089319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.089389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.089478] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.591844] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.594095] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.594095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.594095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.595453] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.595453] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.596028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.596028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.596028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.596114] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.596666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.596666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.596800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.596800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.596869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.597067] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.100205] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.101161] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61d6cfb7-70e3-40e9-910e-91206aa6d806: rpc.has_security_group_logging(os_id): False [ 950.121437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.121607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.121693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.121926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.122029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.122227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.122348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.122448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.122678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.122810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.123164] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.123357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.123404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.123563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.123712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.123834] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.123930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.123994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.124151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.124224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.124311] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 is going to be created. [ 950.195334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.195485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.195557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.195848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.196056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.210854] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 in Status: IN_PROGRESS for 2s [ 950.603323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.603674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.603674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.604513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.604758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.604939] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 950.655027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.655027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.655027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.655027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.655027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.672073] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 950.684107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb in Status: SUCCESS [ 950.684275] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb deletion is rescheduled due to dependency. [ 950.684342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.258491] env[65162]: INFO networking_nsxv3.common.synchronization [req-0807fd19-8fef-4942-933f-cf76d2238300 req-9637bbcd-ce3e-4642-bcb9-eb421b1e6c0d tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_members [ 951.259208] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_members [ 951.259727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.259877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.259938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.260345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.260497] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.260600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.260693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.260913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.260913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.261106] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.749854] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.750292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.750292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.750537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.750809] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.750957] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.751091] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.751315] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.751451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.751676] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.751818] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.751941] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.752068] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.752183] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.752303] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.752433] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.764226] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.764392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.764475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.764710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.764801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.765013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.765121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.765173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.765337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.765417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.765500] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 already deleted. [ 951.765582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.777241] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.777371] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.777478] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.777656] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.778019] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-24f1e499-53cf-4043-9077-589eb5aba6b3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.778210] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.778368] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.778705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.778889] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f1e499-53cf-4043-9077-589eb5aba6b3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.225916] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 in Status: SUCCESS [ 952.226168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.281663] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.282076] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.282282] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.282926] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.283179] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.283384] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 24f1e499-53cf-4043-9077-589eb5aba6b3 not found, creating... [ 952.284441] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.284441] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.284441] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.284684] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.284684] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.285100] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.285366] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.285525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.285951] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.286249] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.286380] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 24f1e499-53cf-4043-9077-589eb5aba6b3 is going to be created. [ 952.309210] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.309439] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.309566] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.309977] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.310078] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.310316] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.464362] env[65162]: INFO networking_nsxv3.common.synchronization [req-9f13eefc-e4c3-4c14-8948-4c1bedc9fabb req-d5533f1a-b4a2-4968-84ff-c131bd0a205d tempest-AttachInterfacesV270Test-141058768 tempest-AttachInterfacesV270Test-141058768-project-member] Enqueued Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_members [ 952.464553] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGHEST for action security_group_members [ 952.464888] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.464984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.465076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.465269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.465428] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.465536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.465642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.465799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.465889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.465987] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.684246] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 952.684483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.684642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.684858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.685074] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.685204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.685269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.685430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.685509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.685604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.685735] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.968700] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.969052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.969052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.969144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.969235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.969422] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.969537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.969626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.969814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.969968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.970152] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c is going to be updated. [ 952.972056] env[65162]: INFO networking_nsxv3.common.synchronization [req-1d54487d-2479-45a3-86ba-10a01c8a4f8c req-5d22e4ea-2d0f-44cc-b9ae-135a34a62a5e tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 952.972620] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 952.973333] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.973482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.973534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.973705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.973883] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.973984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.974059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.974205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.974286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.974383] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.008169] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.008327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.008425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.008683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.008769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.030690] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c in Status: IN_PROGRESS for 2s [ 953.059288] env[65162]: INFO networking_nsxv3.common.synchronization [req-0807fd19-8fef-4942-933f-cf76d2238300 req-a9cd1310-33fe-43d4-a2b1-c987f3a02043 service nova] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_rules [ 953.067771] env[65162]: INFO networking_nsxv3.common.synchronization [req-0807fd19-8fef-4942-933f-cf76d2238300 req-a9cd1310-33fe-43d4-a2b1-c987f3a02043 service nova] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_members [ 953.067771] env[65162]: INFO networking_nsxv3.common.synchronization [req-0807fd19-8fef-4942-933f-cf76d2238300 req-a9cd1310-33fe-43d4-a2b1-c987f3a02043 service nova] Enqueued Resource ID: 24f1e499-53cf-4043-9077-589eb5aba6b3 with Priority: HIGHEST for action port [ 953.067771] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_rules [ 953.067771] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_members [ 953.067771] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24f1e499-53cf-4043-9077-589eb5aba6b3 with Priority: HIGHEST for action port [ 953.067771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.067771] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.067771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.067771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.067771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.069221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.073008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.073008] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.073008] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-24f1e499-53cf-4043-9077-589eb5aba6b3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.073008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.073008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.073008] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.073008] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f1e499-53cf-4043-9077-589eb5aba6b3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.189991] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.189991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.189991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.189991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.190258] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.190258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.190258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.190444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.190548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.190672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.190831] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.190945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.190999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.191187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.191354] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.191447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.191509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.191650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.191728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.191811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.193367] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.476352] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.574076] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.576944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.576944] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.576944] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24f1e499-53cf-4043-9077-589eb5aba6b3 with status ACTIVE [ 953.576944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.576944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.576944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.577933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.578125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.578319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.578537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.578537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.579092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.579092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.579092] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.579092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.579429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.579429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.579429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.579619] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24f1e499-53cf-4043-9077-589eb5aba6b3 is going to be updated. [ 953.604057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.604057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.604057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.604535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.604798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.605083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24f1e499-53cf-4043-9077-589eb5aba6b3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.696760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03c457f4-5193-48c8-99b4-9dd3e8a1a23d: rpc.has_security_group_logging(os_id): False [ 953.769533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.769764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.769832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.770189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.770306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.770555] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.770679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.770781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.771074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.771212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.771477] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.771596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.771663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.771871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.771950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.772247] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.772533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.772533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.772641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.772724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.772815] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 953.849457] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.849675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.849675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.849912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.850107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.872835] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 953.974540] env[65162]: INFO networking_nsxv3.common.synchronization [req-093f7ddc-5521-40fe-9fc9-99c89e890ae3 req-1b501c92-92b9-4c72-91c4-f09ccef44b91 tempest-ServerAddressesTestJSON-870171362 tempest-ServerAddressesTestJSON-870171362-project-member] Enqueued Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_members [ 953.976938] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGHEST for action security_group_members [ 953.977336] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.977505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.977595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.977881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.978452] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.978452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.978452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.978627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.978627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.978776] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.980000] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.081501] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.482214] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.482390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.482474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.482708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.482839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.483123] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.483241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.483331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.483467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.483545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.483632] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caef476-012f-4313-ac05-e9388bfdc717 is going to be updated. [ 954.484858] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.484970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.485169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.485343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.485427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.485519] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 954.518066] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.518066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.518066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.518066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.518347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.520048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.520175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.520234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.520406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.520534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.534658] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: IN_PROGRESS for 2s [ 954.535376] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 954.584298] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.584588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.584588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.585426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.585426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.585426] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 is going to be created. [ 954.618297] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.619108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.619253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.619489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.619661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.634454] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 in Status: UNINITIALIZED for 2s [ 955.043626] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c in Status: SUCCESS [ 955.043922] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c deletion is rescheduled due to dependency. [ 955.043982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.235233] env[65162]: INFO networking_nsxv3.common.synchronization [req-45b5005d-07a8-4b76-8158-8a286bb7ca43 req-391f88d0-9cc8-4cbf-b429-013fca9c6bb4 tempest-ServersWithSpecificFlavorTestJSON-515804645 tempest-ServersWithSpecificFlavorTestJSON-515804645-project-member] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 955.235438] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGHEST for action security_group_members [ 955.236135] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.236135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.238937] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.238937] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.616175] env[65162]: INFO networking_nsxv3.common.synchronization [req-ca45ce6e-b9f5-4a01-9736-f62a5720b1e9 req-2e18bf41-10a6-4f79-a7d1-aa1e5e4de574 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 955.616175] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 955.617666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.620074] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.620074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.620074] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.740700] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.740868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.740940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.741196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.769643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.769643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.769643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.769643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.769643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.769932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.769932] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be updated. [ 955.826767] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.826767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.826767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.826767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.826767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.841235] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: IN_PROGRESS for 2s [ 955.892487] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 955.893515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.126817] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.126817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.126817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.126817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.151457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.151721] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.151852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.151919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.152148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.152336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.152336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 956.194901] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.195085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.195085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.195362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.195784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.205293] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 956.547694] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caef476-012f-4313-ac05-e9388bfdc717 in Status: SUCCESS [ 956.547879] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caef476-012f-4313-ac05-e9388bfdc717 deletion is rescheduled due to dependency. [ 956.548078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.548786] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 956.548953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.646832] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 in Status: SUCCESS [ 956.647134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.647380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.647704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.649672] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.649672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.649672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.649672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.649672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.649672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.649672] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.749536] env[65162]: INFO networking_nsxv3.common.synchronization [req-6ea06258-94ff-49dc-ae22-203c54eaf127 req-cb894177-77ca-4d48-a2d5-2633026dad24 tempest-ServerAddressesNegativeTestJSON-2018635249 tempest-ServerAddressesNegativeTestJSON-2018635249-project-member] Enqueued Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_members [ 956.750348] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGHEST for action security_group_members [ 956.751031] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.751031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.751031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.751233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.752268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.752411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.752496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.752619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.752710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.752811] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.151587] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.255987] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.256161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.256235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.256480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.256573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.256954] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.257120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.257227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.257480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.257573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.257696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 is going to be updated. [ 957.308599] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.308758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.308832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.309068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.309213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.322804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 in Status: IN_PROGRESS for 2s [ 957.657032] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9277ea7b-0e9f-4304-afc4-0c02fdc31f78: rpc.has_security_group_logging(os_id): False [ 957.679301] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.679582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.679711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.680052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.680198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.680683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.680888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.680888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.681201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.681364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.681532] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 is going to be created. [ 957.751124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.752131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.752131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.752131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.752131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.766406] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 in Status: IN_PROGRESS for 2s [ 957.855470] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db in Status: SUCCESS [ 957.855706] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db deletion is rescheduled due to dependency. [ 957.855947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.215033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 958.215358] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 958.215358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.337228] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 in Status: SUCCESS [ 959.337621] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 deletion is rescheduled due to dependency. [ 959.337676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.781583] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 in Status: SUCCESS [ 959.781938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.435793] env[65162]: INFO networking_nsxv3.common.synchronization [req-c941671d-327f-4c96-8eab-8f41fa878166 req-75bfec0f-0168-4d50-a463-73485eecd8e6 tempest-ServersNegativeTestJSON-1754726929 tempest-ServersNegativeTestJSON-1754726929-project-member] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 960.436416] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGHEST for action security_group_members [ 960.436768] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.436909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.436980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.437206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.437367] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.437469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.437525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.437675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.437758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.437853] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.942941] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.942941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.942941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.942941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.962807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.962968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.963100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.963169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.963364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.963444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.963536] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be updated. [ 960.992190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.992190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.992190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.992190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.992190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.001756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: IN_PROGRESS for 2s [ 962.031842] env[65162]: INFO networking_nsxv3.common.synchronization [req-02a0cf59-c42c-4be5-a514-0677f5f90daa req-46ebee0e-585f-4315-b72b-5d47da9471bd tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 962.032402] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 962.032713] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.032838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.032928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.033133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.033289] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.033403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.033468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.033618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.034153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.034153] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.419340] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.419507] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.419582] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.419986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.420190] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.420353] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.420474] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.420690] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.420831] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.421051] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.421165] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.421272] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.421379] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.421489] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.421593] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.421721] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.440829] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.440973] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.441086] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.441273] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.441582] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-85789040-5a6b-4ccc-982f-da74d318b505 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.441787] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.442359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.442359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.442504] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85789040-5a6b-4ccc-982f-da74d318b505',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.537146] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.946825] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.947111] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.947240] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.947582] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.947748] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.947920] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 85789040-5a6b-4ccc-982f-da74d318b505 not found, creating... [ 962.948554] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.948554] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.948805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.948870] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.949023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.949373] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.949563] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.949689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.949898] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.950079] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.950234] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 85789040-5a6b-4ccc-982f-da74d318b505 is going to be created. [ 962.971617] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.971843] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.971975] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.972303] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.972554] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.972810] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.012348] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9998726b-c2cc-495a-9b94-43b9da32545d in Status: SUCCESS [ 963.012348] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d deletion is rescheduled due to dependency. [ 963.012348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.039986] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.543656] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.543656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.543656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.544071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.544168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.544275] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 963.578319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.578508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.578560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.578742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.578950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.590977] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 963.746339] env[65162]: INFO networking_nsxv3.common.synchronization [req-02a0cf59-c42c-4be5-a514-0677f5f90daa req-3e3f67ed-e9e3-4d9a-a978-bf3d316d0ecd service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 963.746521] env[65162]: INFO networking_nsxv3.common.synchronization [req-02a0cf59-c42c-4be5-a514-0677f5f90daa req-3e3f67ed-e9e3-4d9a-a978-bf3d316d0ecd service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 963.746661] env[65162]: INFO networking_nsxv3.common.synchronization [req-02a0cf59-c42c-4be5-a514-0677f5f90daa req-3e3f67ed-e9e3-4d9a-a978-bf3d316d0ecd service nova] Enqueued Resource ID: 85789040-5a6b-4ccc-982f-da74d318b505 with Priority: HIGHEST for action port [ 963.747290] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 963.747422] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 963.747515] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85789040-5a6b-4ccc-982f-da74d318b505 with Priority: HIGHEST for action port [ 963.747843] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.747945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.747945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.748211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.748270] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.749343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.749343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.749343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-85789040-5a6b-4ccc-982f-da74d318b505 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.749596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.749596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.749781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.749781] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85789040-5a6b-4ccc-982f-da74d318b505',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.252710] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.252710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.252710] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85789040-5a6b-4ccc-982f-da74d318b505 with status ACTIVE [ 964.253138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.253138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.253138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.253381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.253437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.253678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.253798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.253863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.258033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.258033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.258033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.258033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.258033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.258033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.258033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.258033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85789040-5a6b-4ccc-982f-da74d318b505 is going to be updated. [ 964.284974] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.285163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.285205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.285483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.285643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.285848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85789040-5a6b-4ccc-982f-da74d318b505" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.604430] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 965.604430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.604877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.604877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.605074] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.606157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.606157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.606157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.606157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.606157] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.110142] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.613837] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.117908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.118098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.118177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.118390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.118479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.118674] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 967.150763] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.150912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.150981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.151219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.151352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.163866] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 968.055644] env[65162]: INFO networking_nsxv3.common.synchronization [None req-8f185580-db53-48b2-bf02-20b14e182a5b None None] Enqueued Resource ID: bacdf791-f66e-49af-92a1-09544ba2f1ba with Priority: HIGHEST for action port [ 968.056657] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bacdf791-f66e-49af-92a1-09544ba2f1ba with Priority: HIGHEST for action port [ 968.056657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-bacdf791-f66e-49af-92a1-09544ba2f1ba taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.056811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bacdf791-f66e-49af-92a1-09544ba2f1ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.056855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bacdf791-f66e-49af-92a1-09544ba2f1ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.059708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bacdf791-f66e-49af-92a1-09544ba2f1ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.059708] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bacdf791-f66e-49af-92a1-09544ba2f1ba',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.561791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bacdf791-f66e-49af-92a1-09544ba2f1ba [ 968.561791] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.561791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.561791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.561791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.562347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.562641] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bacdf791-f66e-49af-92a1-09544ba2f1ba already deleted. [ 968.563438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bacdf791-f66e-49af-92a1-09544ba2f1ba" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.177359] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 969.177647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.178319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.178319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.178319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.178513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.178513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.178595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.178671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.178775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.178881] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.684957] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.684957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.684957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.684957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.684957] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.684957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.684957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.686351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.686351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.686438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.686640] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.686709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.686762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.686910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.687727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.687727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.687727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.687727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.687727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.687727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.688178] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.761177] env[65162]: INFO networking_nsxv3.common.synchronization [req-ebb5f8da-e3ec-410d-9a63-736db4559c25 req-470402c3-7803-4c95-bab2-47b39c76e75a tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 969.761177] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 969.761620] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.761788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.761897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.762308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.763081] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.763081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.763081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.763295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.763393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.763515] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.168430] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.168685] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.168846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.169198] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.169497] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.169661] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.169776] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.170014] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.170162] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.170373] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.170819] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.170988] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.171159] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.171306] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.171416] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.171580] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.190115] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 970.192895] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.193322] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 970.193572] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.193855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.194504] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-9ee5c7f8-69d4-403c-96d4-d40d124d2477 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.194689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.194813] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.195373] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.195512] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee5c7f8-69d4-403c-96d4-d40d124d2477',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.213989] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.214187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.214239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.214505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.232273] env[65162]: INFO networking_nsxv3.common.synchronization [None req-f9fa3515-c2a8-4109-a7d4-c39a4212ae43 None None] Enqueued Resource ID: 312b9f5e-9b2b-4f2b-8594-3bd7fe19325d with Priority: HIGHEST for action port [ 970.232822] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312b9f5e-9b2b-4f2b-8594-3bd7fe19325d with Priority: HIGHEST for action port [ 970.233171] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-312b9f5e-9b2b-4f2b-8594-3bd7fe19325d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.233293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-312b9f5e-9b2b-4f2b-8594-3bd7fe19325d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.233359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-312b9f5e-9b2b-4f2b-8594-3bd7fe19325d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.233718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-312b9f5e-9b2b-4f2b-8594-3bd7fe19325d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.233718] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('312b9f5e-9b2b-4f2b-8594-3bd7fe19325d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.236401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.236652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.236854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.236972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.237258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.237258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.237494] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.237599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.237676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.237809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.238157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.238269] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.238384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.238450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.238592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.238671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.238757] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 970.266536] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.266632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.266632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.266828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.267036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.267129] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.267229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.267291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.267465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.267549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.267636] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 already deleted. [ 970.267717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.302649] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.302827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.302873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.303074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.303221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.323050] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 970.701334] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.701334] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 9ee5c7f8-69d4-403c-96d4-d40d124d2477 not found, creating... [ 970.701334] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.701334] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.701846] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.701846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.701846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.701846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.702151] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.702466] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 9ee5c7f8-69d4-403c-96d4-d40d124d2477 is going to be created. [ 970.724297] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.724875] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.725113] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.725476] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.725833] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.726185] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.735948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 312b9f5e-9b2b-4f2b-8594-3bd7fe19325d [ 970.735948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.735948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.736203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.736203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.737108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.737108] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:312b9f5e-9b2b-4f2b-8594-3bd7fe19325d already deleted. [ 970.737108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-312b9f5e-9b2b-4f2b-8594-3bd7fe19325d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.429203] env[65162]: INFO networking_nsxv3.common.synchronization [req-ebb5f8da-e3ec-410d-9a63-736db4559c25 req-f1eb101b-7ddd-4ba6-b1e1-577813b7a4c7 service nova] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_rules [ 971.429477] env[65162]: INFO networking_nsxv3.common.synchronization [req-ebb5f8da-e3ec-410d-9a63-736db4559c25 req-f1eb101b-7ddd-4ba6-b1e1-577813b7a4c7 service nova] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 971.429477] env[65162]: INFO networking_nsxv3.common.synchronization [req-ebb5f8da-e3ec-410d-9a63-736db4559c25 req-f1eb101b-7ddd-4ba6-b1e1-577813b7a4c7 service nova] Enqueued Resource ID: 9ee5c7f8-69d4-403c-96d4-d40d124d2477 with Priority: HIGHEST for action port [ 971.429682] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_rules [ 971.429810] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 971.429905] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee5c7f8-69d4-403c-96d4-d40d124d2477 with Priority: HIGHEST for action port [ 971.430504] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.430601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.430745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.430969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.431264] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.432811] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.433908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.433981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.434186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.434343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.434450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.434502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.434650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.434733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.434986] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.435562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ee5c7f8-69d4-403c-96d4-d40d124d2477 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.435666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.435849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.436091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.436173] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee5c7f8-69d4-403c-96d4-d40d124d2477',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.934333] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.934333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.939919] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.940878] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ee5c7f8-69d4-403c-96d4-d40d124d2477 with status ACTIVE [ 971.941736] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.941736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.941736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.941736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.941736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.941952] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.942014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.942088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.942268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.942739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.942739] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.942916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.942916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.943174] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.943234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.943479] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ee5c7f8-69d4-403c-96d4-d40d124d2477 is going to be updated. [ 971.965651] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.965805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.965862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.966099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.966235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.966393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ee5c7f8-69d4-403c-96d4-d40d124d2477" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.339182] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 972.339416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.446113] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.948709] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.948709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.948874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.948970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.949076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.949174] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be created. [ 972.974277] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.974444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.974488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.974677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.974832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.984148] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: UNINITIALIZED for 2s [ 974.997451] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: SUCCESS [ 974.997699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.997854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.998109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.998303] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.998412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.998477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.998625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.998704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.998785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.998876] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.500650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.500854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.500854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.501084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.501255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.501356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.501418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.501561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.501647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.501736] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.501881] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.501982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.502080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.502250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.502389] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.502499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.502574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.502743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.502829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.502912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.503012] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.005967] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cf3edd7-c692-47b8-9058-7c2d873d8056: rpc.has_security_group_logging(os_id): False [ 976.027777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.027962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.028115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.028490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.028608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.029019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.029744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.029744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.029744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.029744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.029744] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.029744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.030090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.030090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.030147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.030368] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.030517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.030602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.030787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.031807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.031807] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be created. [ 976.098626] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.098763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.098859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.099086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.099268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.114696] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: IN_PROGRESS for 2s [ 976.431246] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 976.431361] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 978.128875] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: SUCCESS [ 978.129183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.433278] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 981.433644] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 982.311080] env[65162]: INFO networking_nsxv3.common.synchronization [req-8d2df2d9-a499-47d0-9443-e7bb4427ce70 req-f80644a4-658e-4c1f-b205-7a4c13015fc9 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_members [ 982.311080] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGHEST for action security_group_members [ 982.311429] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.311529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.311588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.312429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.312429] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.312429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.312429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.312429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.312733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.312733] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.815519] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.815911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.815911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.816042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.839041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.839308] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.839432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.839498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.839691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.839771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.839859] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 is going to be updated. [ 982.866858] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.866858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.866858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.866858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.867274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.875930] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 in Status: IN_PROGRESS for 2s [ 983.466946] env[65162]: INFO networking_nsxv3.common.synchronization [req-5bc62683-59e7-4ace-bb04-953c8cfde01f req-d9769eee-e8e0-47b2-bb2e-0c5e9495a6e3 tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 983.467519] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 983.467949] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.471199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.471334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.471481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.471658] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.471764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.471844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.471969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.472069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.472164] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.975623] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.976211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.976211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.976211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.976487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.976535] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.976624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.976690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.976815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.976983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.977093] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 984.013875] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.014509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.014707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.015085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.015360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.026455] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 984.887949] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 in Status: SUCCESS [ 984.888204] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 deletion is rescheduled due to dependency. [ 984.888332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.037265] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 986.037647] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 986.037647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.020873] env[65162]: INFO networking_nsxv3.common.synchronization [None req-0cee7d3a-8123-45ba-9721-0d5811d4dcb5 None None] Enqueued Resource ID: 6b035d4f-5178-4538-90bd-46a77abaa46f with Priority: HIGHEST for action port [ 987.020873] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b035d4f-5178-4538-90bd-46a77abaa46f with Priority: HIGHEST for action port [ 987.020873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b035d4f-5178-4538-90bd-46a77abaa46f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.020873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b035d4f-5178-4538-90bd-46a77abaa46f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.020873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b035d4f-5178-4538-90bd-46a77abaa46f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.021253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b035d4f-5178-4538-90bd-46a77abaa46f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.021395] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b035d4f-5178-4538-90bd-46a77abaa46f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.523583] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b035d4f-5178-4538-90bd-46a77abaa46f [ 987.523951] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.524179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.524305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.524638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.524812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.525112] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b035d4f-5178-4538-90bd-46a77abaa46f already deleted. [ 987.525112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b035d4f-5178-4538-90bd-46a77abaa46f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.828893] env[65162]: INFO networking_nsxv3.common.synchronization [req-e59f7a25-423e-4290-9b0e-b7ec1be9798a req-d9dcbeda-abd7-4c43-a95a-45a8cbd7f38b tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_members [ 989.829607] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGHEST for action security_group_members [ 989.829844] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.829936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.829969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.830234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.831136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.831283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.831402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.831542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.831632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.831724] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.880571] env[65162]: INFO networking_nsxv3.common.synchronization [None req-ed5c63a1-c425-45d1-a1aa-e2200c12329d None None] Enqueued Resource ID: b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8 with Priority: HIGHEST for action port [ 989.881837] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8 with Priority: HIGHEST for action port [ 989.882155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.882271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.882336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.882659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.882745] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.334120] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.334609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.334687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.334932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.360043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.360043] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.360043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.360043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.360043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.360523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.360523] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 is going to be updated. [ 990.386784] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8 [ 990.387082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.387221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.387290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.387544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.387580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.387906] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8 already deleted. [ 990.387906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b96a41da-8bce-4b5d-8cf8-2d0c7d6712f8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.389608] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.389608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.389608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.389608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.389608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.398479] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 in Status: IN_PROGRESS for 2s [ 990.984750] env[65162]: INFO networking_nsxv3.common.synchronization [req-5cbcc0c0-b50a-440a-91ff-9e3ec9933291 req-d3383265-234f-4ff5-b21c-a02e3a323a00 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 990.985113] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 990.985434] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.985565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.985633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.985865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.985973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.986532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.986605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.986840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.986840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.986952] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.420241] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.420241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.420241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.420393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.420717] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.420805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.420961] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.421101] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.421212] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.421426] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.421532] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.421636] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.421742] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.422502] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.422640] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.422775] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.449401] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.449401] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.449587] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.449633] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.450454] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-6a057189-a1c2-4578-9591-f6c2aace3218 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.450454] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.450454] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.450689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.450689] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a057189-a1c2-4578-9591-f6c2aace3218',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.489221] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.489396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.489469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.489712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.489805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.490075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.490151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.490198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.490358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.490437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.490538] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 991.529910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.530180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.530180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.530377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.530552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.540848] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 991.953125] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.953385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.953506] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.953854] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.954042] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.954213] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 6a057189-a1c2-4578-9591-f6c2aace3218 not found, creating... [ 991.954455] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.954601] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.954745] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.954920] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.955142] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.955435] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.955584] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.955695] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.955892] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.956254] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.956433] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 6a057189-a1c2-4578-9591-f6c2aace3218 is going to be created. [ 991.976192] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.976469] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.976624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.976939] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.977213] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.977499] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.408952] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 in Status: SUCCESS [ 992.409297] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 deletion is rescheduled due to dependency. [ 992.409297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.761318] env[65162]: INFO networking_nsxv3.common.synchronization [req-5cbcc0c0-b50a-440a-91ff-9e3ec9933291 req-5b1673ca-38c3-4d05-82e6-e8c20c7d3f41 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 992.761532] env[65162]: INFO networking_nsxv3.common.synchronization [req-5cbcc0c0-b50a-440a-91ff-9e3ec9933291 req-5b1673ca-38c3-4d05-82e6-e8c20c7d3f41 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 992.761684] env[65162]: INFO networking_nsxv3.common.synchronization [req-5cbcc0c0-b50a-440a-91ff-9e3ec9933291 req-5b1673ca-38c3-4d05-82e6-e8c20c7d3f41 service nova] Enqueued Resource ID: 6a057189-a1c2-4578-9591-f6c2aace3218 with Priority: HIGHEST for action port [ 992.762265] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 992.762420] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 992.762557] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a057189-a1c2-4578-9591-f6c2aace3218 with Priority: HIGHEST for action port [ 992.763018] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.763168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.763236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.763438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.763541] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.764663] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.764663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.765313] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a057189-a1c2-4578-9591-f6c2aace3218 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.765427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.765493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.765734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.765834] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a057189-a1c2-4578-9591-f6c2aace3218',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.267763] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.267924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.268098] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a057189-a1c2-4578-9591-f6c2aace3218 with status ACTIVE [ 993.268969] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.268969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.268969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.268969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.268969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.269407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.269407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.269407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.269407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.269565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.269625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.269763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.269763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.269937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.270026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.270116] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a057189-a1c2-4578-9591-f6c2aace3218 is going to be updated. [ 993.303282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.303409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.304032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.304032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.304032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.304032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a057189-a1c2-4578-9591-f6c2aace3218" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.551593] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 993.551888] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 993.551888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.552048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.552266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.552448] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.552586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.552687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.552852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.552939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.553054] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.055211] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.557336] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.062105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.063252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.063337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.063578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.063673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.063806] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 995.177995] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.178271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.178386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.178694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.178930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.189535] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 995.557689] env[65162]: INFO networking_nsxv3.common.synchronization [None req-082b5b06-8beb-4dd2-9708-155207b85491 None None] Enqueued Resource ID: adfa2615-0c77-4d7f-9e68-4353b113dc61 with Priority: HIGHEST for action port [ 995.558472] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adfa2615-0c77-4d7f-9e68-4353b113dc61 with Priority: HIGHEST for action port [ 995.558880] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-adfa2615-0c77-4d7f-9e68-4353b113dc61 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.559587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adfa2615-0c77-4d7f-9e68-4353b113dc61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.559587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adfa2615-0c77-4d7f-9e68-4353b113dc61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.559587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adfa2615-0c77-4d7f-9e68-4353b113dc61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.559587] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adfa2615-0c77-4d7f-9e68-4353b113dc61',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.062884] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adfa2615-0c77-4d7f-9e68-4353b113dc61 [ 996.063289] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.063511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.064626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.064876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.066170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.066302] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adfa2615-0c77-4d7f-9e68-4353b113dc61 already deleted. [ 996.066422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adfa2615-0c77-4d7f-9e68-4353b113dc61" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.202250] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 997.202763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.202763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.202871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.203027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.203148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.203208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.203358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.203452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.203524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.203524] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.709829] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.709829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.710087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.710889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.711147] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.711289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.711338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.711519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.711606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.711696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.711854] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.711946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.712014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.712206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.712403] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.712480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.712518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.712730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.712730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.712792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.712949] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.215808] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 542ab4ea-1934-47eb-b35d-a11a9e723c30: rpc.has_security_group_logging(os_id): False [ 998.236782] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.237065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.237136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.237501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.237501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.237746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.237746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.238023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.238023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.238023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.238453] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.238453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.238453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.238610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.238610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.238978] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.238978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.238978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.239222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.239222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.239332] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 998.328459] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.328651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.328700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.328988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.329197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.351773] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 998.669277] env[65162]: INFO networking_nsxv3.common.synchronization [None req-4da05f3d-92a9-4d32-9041-30ea62352efe None None] Enqueued Resource ID: 05304b4f-4fde-4c7f-8a2c-915634b9a143 with Priority: HIGHEST for action port [ 998.669899] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05304b4f-4fde-4c7f-8a2c-915634b9a143 with Priority: HIGHEST for action port [ 998.670388] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-05304b4f-4fde-4c7f-8a2c-915634b9a143 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.670564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05304b4f-4fde-4c7f-8a2c-915634b9a143" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.670666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05304b4f-4fde-4c7f-8a2c-915634b9a143" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.671231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05304b4f-4fde-4c7f-8a2c-915634b9a143" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.671368] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05304b4f-4fde-4c7f-8a2c-915634b9a143',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.140813] env[65162]: INFO networking_nsxv3.common.synchronization [req-74a37a4a-7f1c-4966-a7f3-5dec953af2d7 req-aa163229-65ff-408d-b7c4-be2b75779413 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 999.141396] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 999.141713] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.141837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.141904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.142213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.142376] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.145035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.145035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.145035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.145035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.145035] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.173092] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05304b4f-4fde-4c7f-8a2c-915634b9a143 [ 999.173396] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.173560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.173636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.173888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.173991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.174209] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05304b4f-4fde-4c7f-8a2c-915634b9a143 already deleted. [ 999.174314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05304b4f-4fde-4c7f-8a2c-915634b9a143" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.645015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.645355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.645355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.645475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.645567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.645766] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.645866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.645930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.646238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.646321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.646422] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be updated. [ 999.678215] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.678463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.678463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.678658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.678794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.691172] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: IN_PROGRESS for 2s [ 1000.365513] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1000.365776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.843078] env[65162]: INFO networking_nsxv3.common.synchronization [req-8b0cb174-2ccd-4bd7-86b2-9fa13e368675 req-353c87b3-fae1-4bf6-bfd1-7964210a1238 tempest-ServerTagsTestJSON-1666738383 tempest-ServerTagsTestJSON-1666738383-project-member] Enqueued Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_members [ 1000.843879] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_members [ 1000.844401] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.844401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.844634] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.844715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.844871] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.845097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.845097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.845205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.845323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.845386] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.227680] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-814 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.227877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-814" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.228008] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-814" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.228422] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-814" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.228705] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.228866] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.228982] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.229222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.229374] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.229579] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.229692] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.229802] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.229908] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.230028] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.230136] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.230265] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.253951] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.255347] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.255553] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.256507] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-814" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.256507] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.256507] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.256507] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.256847] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.257049] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb15704c-aa16-4ee6-b2a4-53ab98b4849f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.348013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.348270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.348270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.348735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.348735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.348735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.349070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.349070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.349070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.349227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.349227] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b already deleted. [ 1001.349327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.711700] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: SUCCESS [ 1001.712190] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 deletion is rescheduled due to dependency. [ 1001.712190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.761756] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.761756] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.761756] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.761756] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.761756] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.761756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port cb15704c-aa16-4ee6-b2a4-53ab98b4849f not found, creating... [ 1001.762218] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.762218] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.762218] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.762443] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.762798] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.762874] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.762994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.763111] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.763351] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.763492] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.763632] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: cb15704c-aa16-4ee6-b2a4-53ab98b4849f is going to be created. [ 1001.787072] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.789023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.789023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.789023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.789023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.789023] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.489688] env[65162]: INFO networking_nsxv3.common.synchronization [req-8b0cb174-2ccd-4bd7-86b2-9fa13e368675 req-e7649123-04af-459a-887c-3d0aa0d082cb service nova] Enqueued Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_rules [ 1002.491032] env[65162]: INFO networking_nsxv3.common.synchronization [req-8b0cb174-2ccd-4bd7-86b2-9fa13e368675 req-e7649123-04af-459a-887c-3d0aa0d082cb service nova] Enqueued Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_members [ 1002.491032] env[65162]: INFO networking_nsxv3.common.synchronization [req-8b0cb174-2ccd-4bd7-86b2-9fa13e368675 req-e7649123-04af-459a-887c-3d0aa0d082cb service nova] Enqueued Resource ID: cb15704c-aa16-4ee6-b2a4-53ab98b4849f with Priority: HIGHEST for action port [ 1002.491032] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_rules [ 1002.491261] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_members [ 1002.491382] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb15704c-aa16-4ee6-b2a4-53ab98b4849f with Priority: HIGHEST for action port [ 1002.492187] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.492383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.492499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.492862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.493024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.494941] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.495146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.496874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.496874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.496874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.496874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.496874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.496874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.497393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.497393] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.498865] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.499060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.499839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.499839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.499839] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb15704c-aa16-4ee6-b2a4-53ab98b4849f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.995983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.996203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.999619] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.003151] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb15704c-aa16-4ee6-b2a4-53ab98b4849f with status ACTIVE [ 1003.003151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.003151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.003151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.003151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.003151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.003151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.003151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.003573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.003573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.003573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.003663] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.003709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.003793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.003893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.003963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.004078] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb15704c-aa16-4ee6-b2a4-53ab98b4849f is going to be updated. [ 1003.028372] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.028612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.028612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.028886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.029050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.029219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb15704c-aa16-4ee6-b2a4-53ab98b4849f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.305217] env[65162]: INFO networking_nsxv3.common.synchronization [req-16c92d76-da72-4e56-8b19-983d6766e5c6 req-74bd6197-2306-497c-b01d-0609af48a9af tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1003.305217] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1003.305217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.306011] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.307191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.307191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.309510] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.309510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.309510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.309510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.309510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.309510] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.502430] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.674149] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.674149] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.674149] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.674149] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.674149] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.674149] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.674149] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.675010] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.675336] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.675832] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.676097] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.676367] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.676612] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.676826] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.677082] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.677336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.704035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.704035] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.704035] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.704035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.704035] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-3e6ee58c-8724-4b10-b21b-27469a3dfc17 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.704035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.704035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.704035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.704035] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6ee58c-8724-4b10-b21b-27469a3dfc17',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.810639] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.005852] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.006088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.006167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.006387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.006477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.006597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b is going to be created. [ 1004.029241] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.029461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.029461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.029673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.029819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.039817] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b in Status: UNINITIALIZED for 2s [ 1004.207812] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.208058] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.208189] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.208489] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.208638] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.208791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 3e6ee58c-8724-4b10-b21b-27469a3dfc17 not found, creating... [ 1004.209093] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.209307] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.209433] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.209605] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.209763] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.210065] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.210224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.210338] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.210539] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.210669] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.210830] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 3e6ee58c-8724-4b10-b21b-27469a3dfc17 is going to be created. [ 1004.230347] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.230555] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.230666] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.230992] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.231251] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.231478] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.313665] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.817180] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.817636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.817636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.817776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.817776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.817860] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1004.848945] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.848945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.848945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.849241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.849241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.859293] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1004.958704] env[65162]: INFO networking_nsxv3.common.synchronization [req-16c92d76-da72-4e56-8b19-983d6766e5c6 req-61de9a4d-53bf-4eee-b417-2f472c484dd1 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 1004.958876] env[65162]: INFO networking_nsxv3.common.synchronization [req-16c92d76-da72-4e56-8b19-983d6766e5c6 req-61de9a4d-53bf-4eee-b417-2f472c484dd1 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1004.959022] env[65162]: INFO networking_nsxv3.common.synchronization [req-16c92d76-da72-4e56-8b19-983d6766e5c6 req-61de9a4d-53bf-4eee-b417-2f472c484dd1 service nova] Enqueued Resource ID: 3e6ee58c-8724-4b10-b21b-27469a3dfc17 with Priority: HIGHEST for action port [ 1004.959547] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 1004.960239] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1004.960239] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6ee58c-8724-4b10-b21b-27469a3dfc17 with Priority: HIGHEST for action port [ 1004.960239] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.960555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.960555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.960555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.960746] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.961994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.961994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.962407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6ee58c-8724-4b10-b21b-27469a3dfc17 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.962542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.962678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.962858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.963919] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6ee58c-8724-4b10-b21b-27469a3dfc17',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.465511] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.465648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.465841] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e6ee58c-8724-4b10-b21b-27469a3dfc17 with status ACTIVE [ 1005.466041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.466187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.466265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.466477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.466570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.466742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.466851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.466890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.467048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.467128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.467299] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.467389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.467448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.467582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.467655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.467738] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e6ee58c-8724-4b10-b21b-27469a3dfc17 is going to be updated. [ 1005.488551] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.488551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.488551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.488780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.488780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.488904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6ee58c-8724-4b10-b21b-27469a3dfc17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.935447] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4bb5c2d-e5de-46f3-a89a-f22885cc8a1c req-15f22cf8-8f5c-47f7-a18e-20fe3cb7d9e4 tempest-ListServerFiltersTestJSON-1545369510 tempest-ListServerFiltersTestJSON-1545369510-project-member] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1005.935748] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1005.936857] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.937046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.937143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.937433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.938230] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.938381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.938381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.938487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.938575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.938673] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.053183] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b in Status: SUCCESS [ 1006.053183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.053183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.053183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.053475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.053475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.053608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.053643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.053751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.053871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.054083] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.293472] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.293472] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.293472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.294266] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.294593] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.294817] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.295059] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.295277] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.295482] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.296682] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.318119] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.318119] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.318119] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.318119] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.318119] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.318119] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.318119] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.318119] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.318119] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.441239] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.442683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.442683] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d already deleted. [ 1006.442683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.557200] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.557501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.557718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.558017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.558261] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.558608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.558608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.558824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.559046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.559201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.559405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.559558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.559657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.559839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.559996] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.560131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.560200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.560300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.560378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.560461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.560552] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.821623] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.821899] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.822037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.822362] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.822510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.822666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff not found, creating... [ 1006.822929] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.823100] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.823219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.823439] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.823577] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.823863] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.824030] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.824149] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.824356] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.824490] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.824651] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff is going to be created. [ 1006.845521] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.845746] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.845884] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.846218] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.846461] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.846690] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.869931] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1006.870101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.870261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.870476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.870658] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.870776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.870841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.870993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.871087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.871188] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.064161] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f119f3ea-37d4-4fbd-902f-2e9a18c9729b: rpc.has_security_group_logging(os_id): False [ 1007.093345] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.093345] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.093345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.094032] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.094032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.094032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.094032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.094032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.094213] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.094260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.094294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.094456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.094528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.094638] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b is going to be created. [ 1007.175614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.175614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.175614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.175614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.175614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.188783] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b in Status: IN_PROGRESS for 2s [ 1007.373832] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.569506] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4bb5c2d-e5de-46f3-a89a-f22885cc8a1c req-14e0171d-49e2-461c-8f0c-8f10514008d6 service nova] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_rules [ 1007.569696] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4bb5c2d-e5de-46f3-a89a-f22885cc8a1c req-14e0171d-49e2-461c-8f0c-8f10514008d6 service nova] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1007.569837] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4bb5c2d-e5de-46f3-a89a-f22885cc8a1c req-14e0171d-49e2-461c-8f0c-8f10514008d6 service nova] Enqueued Resource ID: c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff with Priority: HIGHEST for action port [ 1007.570463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_rules [ 1007.570542] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1007.570894] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff with Priority: HIGHEST for action port [ 1007.570894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.571062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.575026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.575303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.575603] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.576317] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.576457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.576517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.576689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.576834] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.576928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.576995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.577152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.577243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.577334] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.580859] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.582586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.582586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.582586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.582586] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.849785] env[65162]: INFO networking_nsxv3.common.synchronization [req-5f6a8c64-0530-4b7b-ba0f-3744078bdbee req-b19cebe1-4781-4de8-8154-3cf6fd1045b4 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1007.850802] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1007.850802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.850802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.850997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.851137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.851343] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.851457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.851545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.851709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.851793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.851907] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.883144] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.086630] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.086895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.086995] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff with status ACTIVE [ 1008.087246] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.087376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.087376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.087543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.087691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.087779] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.087865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.087934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.088073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.088149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.088322] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.088482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.088552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.088679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.088751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.088836] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff is going to be updated. [ 1008.090308] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.113368] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.113561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.113561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.114179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.114179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.114179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4cbb50d-7b5a-4e54-bf4d-cd23a93199ff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.354219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.354428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.354500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.354726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.354818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.355029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.355129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.355192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.355337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.355412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.355501] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1008.385549] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.385748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.385796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.385987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.386142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.386252] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1008.393099] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.393254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.393303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.393518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.393656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.402629] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1008.417904] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.418074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.418148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.418354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.418677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.427971] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1008.489833] env[65162]: INFO networking_nsxv3.common.synchronization [req-86537451-a78a-45a7-8352-4ad282def76e req-ca59ac6b-2893-476e-9dee-8d5c095129ed tempest-ListServerFiltersTestJSON-1545369510 tempest-ListServerFiltersTestJSON-1545369510-project-member] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1008.490446] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1008.490817] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.491677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.592651] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.903467] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.903467] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.903692] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.903847] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.906195] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.907138] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.907138] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.907138] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.907354] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.907682] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.911293] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.911422] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.911524] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.911726] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.911860] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.912088] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.934810] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.934992] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.936093] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.936093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.936093] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-2c09895e-1b92-4cd8-9830-1bae50623128 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.936093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.936093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.936440] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.936573] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c09895e-1b92-4cd8-9830-1bae50623128',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.095744] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.096137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.096137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.096304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.096395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.096494] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be created. [ 1009.121660] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.121849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.121976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.122283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.122458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.133092] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: UNINITIALIZED for 2s [ 1009.201026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b in Status: SUCCESS [ 1009.201262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.441528] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.441912] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.442139] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.442523] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.442726] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.444301] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 2c09895e-1b92-4cd8-9830-1bae50623128 not found, creating... [ 1009.444301] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.444301] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.444427] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.445040] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.445040] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.445336] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.445530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.445681] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.445945] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.446163] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.446328] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 2c09895e-1b92-4cd8-9830-1bae50623128 is going to be created. [ 1009.468665] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.468912] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.469050] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.469359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.469630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.470422] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.201033] env[65162]: INFO networking_nsxv3.common.synchronization [req-86537451-a78a-45a7-8352-4ad282def76e req-d2ba7cc6-eef6-491a-9fd1-deeadc747239 service nova] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_rules [ 1010.201277] env[65162]: INFO networking_nsxv3.common.synchronization [req-86537451-a78a-45a7-8352-4ad282def76e req-d2ba7cc6-eef6-491a-9fd1-deeadc747239 service nova] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1010.201487] env[65162]: INFO networking_nsxv3.common.synchronization [req-86537451-a78a-45a7-8352-4ad282def76e req-d2ba7cc6-eef6-491a-9fd1-deeadc747239 service nova] Enqueued Resource ID: 2c09895e-1b92-4cd8-9830-1bae50623128 with Priority: HIGHEST for action port [ 1010.202430] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_rules [ 1010.202430] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1010.202430] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c09895e-1b92-4cd8-9830-1bae50623128 with Priority: HIGHEST for action port [ 1010.202430] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.202643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.202643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.202716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.202952] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c09895e-1b92-4cd8-9830-1bae50623128 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.203123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.204081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.204081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.204081] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c09895e-1b92-4cd8-9830-1bae50623128',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.416418] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1010.416418] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 1010.416522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.440035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1010.440291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.440474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.440990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.441105] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.441262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.441313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.441700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.441865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.442061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.442236] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.706110] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c09895e-1b92-4cd8-9830-1bae50623128 with status ACTIVE [ 1010.706110] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.706110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.706370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.706427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.706513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.706763] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.706893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.706980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.707250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.707796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.708080] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.708278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.708314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.708528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.708677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.708764] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c09895e-1b92-4cd8-9830-1bae50623128 is going to be updated. [ 1010.744162] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.744366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.744366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.744533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.744682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.744844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c09895e-1b92-4cd8-9830-1bae50623128" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.946565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.946730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.946802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.947039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.947226] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.947347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.947412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.947571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.947659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.947756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.947906] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.948028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.948071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.948252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.948603] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.948603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.948603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.948772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.948772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.948849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.948882] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.092052] env[65162]: INFO networking_nsxv3.common.synchronization [req-ad385fc9-1f81-40f9-9b62-8b6366304bcf req-08a60453-4377-4f13-8342-a90c22a57f47 tempest-ListServerFiltersTestJSON-1545369510 tempest-ListServerFiltersTestJSON-1545369510-project-member] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1011.092645] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1011.092966] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.093085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.143426] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1011.143681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.143869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.144118] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.144450] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.144450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.144601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.144638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.144730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.144783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.144874] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.145817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.145920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.146174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.146356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.146430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.146595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.146811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.146811] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.451804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 1011.460332] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.460562] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.461617] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.461617] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.461617] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.461617] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.461617] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.461887] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.461887] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.462066] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.466377] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.466460] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.466569] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.466686] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.466789] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.467795] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.486625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.486783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.486832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.487089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.487175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.487375] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.487476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.487540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.487703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.487781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.487974] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.488084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.488146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.488284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.488661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.488661] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.488661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.488809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.488843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.488923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.489018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1011.490743] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.490907] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.491607] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.491820] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-600" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.492410] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-7ff69ca0-8f89-45d5-ba55-7736f6007491 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.492584] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.492694] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.492975] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.493250] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff69ca0-8f89-45d5-ba55-7736f6007491',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.567471] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.567637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.567696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.567887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.568041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.583099] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1011.650105] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.651721] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.651918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.995348] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.995641] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.995789] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.996173] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.996346] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.996514] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 7ff69ca0-8f89-45d5-ba55-7736f6007491 not found, creating... [ 1011.996778] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.996942] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.997101] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.997287] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.997423] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.997703] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.997868] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.997982] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.998197] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.998329] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.998488] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 7ff69ca0-8f89-45d5-ba55-7736f6007491 is going to be created. [ 1012.019481] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.019716] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.019880] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.020236] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.020516] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.020815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.153453] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.655652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.656186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.656186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.656331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.656471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.656601] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1012.688865] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.689561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.689561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.690085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.690085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.700967] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1012.779579] env[65162]: INFO networking_nsxv3.common.synchronization [req-ad385fc9-1f81-40f9-9b62-8b6366304bcf req-8e09ff60-91fd-4da3-8726-e996ac61e3b8 service nova] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_rules [ 1012.779763] env[65162]: INFO networking_nsxv3.common.synchronization [req-ad385fc9-1f81-40f9-9b62-8b6366304bcf req-8e09ff60-91fd-4da3-8726-e996ac61e3b8 service nova] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1012.779888] env[65162]: INFO networking_nsxv3.common.synchronization [req-ad385fc9-1f81-40f9-9b62-8b6366304bcf req-8e09ff60-91fd-4da3-8726-e996ac61e3b8 service nova] Enqueued Resource ID: 7ff69ca0-8f89-45d5-ba55-7736f6007491 with Priority: HIGHEST for action port [ 1012.780471] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_rules [ 1012.780617] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1012.780720] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff69ca0-8f89-45d5-ba55-7736f6007491 with Priority: HIGHEST for action port [ 1012.781011] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.781122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.781331] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.781414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.781581] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff69ca0-8f89-45d5-ba55-7736f6007491 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.781673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.781779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.781923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.782012] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff69ca0-8f89-45d5-ba55-7736f6007491',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.288026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ff69ca0-8f89-45d5-ba55-7736f6007491 with status ACTIVE [ 1013.288026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.288026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.288026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.288026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.288026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ff69ca0-8f89-45d5-ba55-7736f6007491 is going to be updated. [ 1013.312610] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.312610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.312610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.312610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.312610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.312610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff69ca0-8f89-45d5-ba55-7736f6007491" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.604704] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1013.605029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.715603] env[65162]: INFO networking_nsxv3.common.synchronization [req-69c54284-4ad1-4706-b0a7-9d600b7a01ff req-bddce2f3-eb74-4549-9cda-9abbeabff44c tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 1013.716156] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 1013.716472] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.716589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.716660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.716892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.717435] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.717435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.717581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.717623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.717699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.717799] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.082700] env[65162]: INFO networking_nsxv3.common.synchronization [req-de9eb2d2-1d24-4f99-9456-329b58ab5170 req-2fe7494a-b40c-4387-b03f-223ce978dd4c tempest-ServerTagsTestJSON-1666738383 tempest-ServerTagsTestJSON-1666738383-project-member] Enqueued Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_members [ 1014.082898] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGHEST for action security_group_members [ 1014.083243] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.083371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.083435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.083654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.083793] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.083904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.083954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.084135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.084223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.084319] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.127873] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.128090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.128247] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.128551] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.129151] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.129347] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.129478] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.129726] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.129897] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.130191] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.130253] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.130386] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.130499] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.130625] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.130738] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.130876] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.151109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.151109] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.151109] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.151109] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-99" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.151513] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-b4a31918-c988-44c7-b4c0-a391d79fdcc6 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.151715] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.152222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.152222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.152343] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a31918-c988-44c7-b4c0-a391d79fdcc6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.221031] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.221031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.221031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.221031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.221031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.221389] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.221389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.221389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.221524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.222483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.222483] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 1014.251678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.251893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.251970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.252204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.252349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.263206] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 1014.587709] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.587930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.588098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.588569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.588668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.588960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.589151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.589259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.589505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.589666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.589839] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b is going to be updated. [ 1014.626619] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.626619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.626619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.626619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.626619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.637892] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b in Status: IN_PROGRESS for 2s [ 1014.656609] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.656874] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.657191] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.657429] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.657587] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.657745] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port b4a31918-c988-44c7-b4c0-a391d79fdcc6 not found, creating... [ 1014.658016] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.658293] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.658688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.658999] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.659166] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.659468] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.659619] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.659733] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.659939] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.660087] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.660223] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: b4a31918-c988-44c7-b4c0-a391d79fdcc6 is going to be created. [ 1014.687214] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.687494] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.687739] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.688158] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.688443] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.688755] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.711202] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1014.711422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.711590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.711804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.711992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.712125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.712198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.712354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.712433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.712529] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.215140] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.382987] env[65162]: INFO networking_nsxv3.common.synchronization [req-69c54284-4ad1-4706-b0a7-9d600b7a01ff req-325465d0-dc8d-49d4-a92e-08b1b5a66c9f service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 1015.383230] env[65162]: INFO networking_nsxv3.common.synchronization [req-69c54284-4ad1-4706-b0a7-9d600b7a01ff req-325465d0-dc8d-49d4-a92e-08b1b5a66c9f service nova] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 1015.383358] env[65162]: INFO networking_nsxv3.common.synchronization [req-69c54284-4ad1-4706-b0a7-9d600b7a01ff req-325465d0-dc8d-49d4-a92e-08b1b5a66c9f service nova] Enqueued Resource ID: b4a31918-c988-44c7-b4c0-a391d79fdcc6 with Priority: HIGHEST for action port [ 1015.383904] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_rules [ 1015.385463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 1015.385634] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a31918-c988-44c7-b4c0-a391d79fdcc6 with Priority: HIGHEST for action port [ 1015.385951] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.386146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.386258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.386461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.386536] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.388246] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.388375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.388861] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4a31918-c988-44c7-b4c0-a391d79fdcc6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.388861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.388861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.389117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.389117] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a31918-c988-44c7-b4c0-a391d79fdcc6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.719095] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.889625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.889625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.891671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4a31918-c988-44c7-b4c0-a391d79fdcc6 with status ACTIVE [ 1015.891671] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.891671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.891671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.891968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.891968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.895319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.895449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.895513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.895744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.895826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.896078] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.896200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.896287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.896449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.896539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.896655] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4a31918-c988-44c7-b4c0-a391d79fdcc6 is going to be updated. [ 1015.923155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.923354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.923419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.923596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.923753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.923963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4a31918-c988-44c7-b4c0-a391d79fdcc6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.224855] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.224855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.224855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.225291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.225291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.225291] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1016.261373] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.261499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.261537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.261806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.262017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.275664] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1016.276675] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 1016.276862] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 1016.276978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.277173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.277407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.277693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.277840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.277912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.278317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.278468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.278616] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.651018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b in Status: SUCCESS [ 1016.651226] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b deletion is rescheduled due to dependency. [ 1016.651329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.719818] env[65162]: INFO networking_nsxv3.common.synchronization [None req-bba16f43-283d-49c0-a62e-c6570e4b15e6 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_rules [ 1016.720448] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_rules [ 1016.720828] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.720976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.721622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.721968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.722239] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.783465] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.833306] env[65162]: INFO networking_nsxv3.common.synchronization [None req-282baef6-83f9-4b3b-b02e-63cd275a3010 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_rules [ 1016.834035] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_rules [ 1016.834573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.834704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.249785] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.250211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.250211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.250303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.250348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.250418] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 already deleted. [ 1017.250504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.250653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.250803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.250887] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.287302] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.385108] env[65162]: INFO networking_nsxv3.common.synchronization [req-3a17edee-3389-4418-9baf-7c9cc4fe92fb req-5457c011-48a3-458a-b30b-24c96f953238 tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1017.385831] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1017.387040] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.387040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.387040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.387040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.387040] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.387040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.387040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.387402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.387402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.387402] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.782499] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.782795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.782894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.783252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.783410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.783550] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 already deleted. [ 1017.783675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.789812] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.789812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.789812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.790114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.791061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.791061] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 1017.838778] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.839361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.839801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.840268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.840624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.852097] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 1017.890106] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.291062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1018.291411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.291451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.291671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.291876] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.293045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.293045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.293045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.293045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.293045] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.391856] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.798036] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.896371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.896538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.896619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.896871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.896966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.897100] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1018.930735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.930897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.930950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.931191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.931413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.941118] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1019.300150] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.802702] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.802995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.803298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.803569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.803718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.803877] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1019.836883] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.837075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.837203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.837514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.837776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.851520] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1019.862819] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 1019.863088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.863273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.863547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.863772] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.863923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.864023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.864335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.864440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.864592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.864735] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.367788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.368199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.368199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.368310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.368564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.368663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.368699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.368899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.369028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.369152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.369531] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.369531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.369666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.369842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.370065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.370188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.370275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.370432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.370516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.370722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.370722] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.873776] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55eb5d3-a252-4f36-9046-1505d8f8fa4e: rpc.has_security_group_logging(os_id): False [ 1020.894559] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.894745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.894789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.894972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.895080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.895312] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.895407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.895468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.896150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.896284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.896465] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.896586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.896648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.896800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.896875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.897077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.897169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.897228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.897368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.897442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.897524] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 1020.952864] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1020.953245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.980049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.980049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.980479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.980479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.980582] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.997710] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 1021.225111] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bdb008b-1dbf-4e89-a395-ddb6686d1c10 req-b64f8555-32b9-4ba8-ac74-94fdf2cb0ac7 tempest-ServerMetadataTestJSON-1712406949 tempest-ServerMetadataTestJSON-1712406949-project-member] Enqueued Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_members [ 1021.225777] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_members [ 1021.226124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.226311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.226438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.226626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.226785] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.226917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.226999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.227105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.227201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.227274] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.579960] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.580938] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.580938] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.581070] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.581419] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.582519] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.582519] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.582519] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.582519] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.582723] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.583606] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.583606] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.583606] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.583606] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.583606] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.583815] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.605124] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.605418] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.605418] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.605694] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-27" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.605968] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.606329] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.606555] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.606945] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.606997] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.729555] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.729843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.729843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.730233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.730354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.730521] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.730641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.730802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.730881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.730939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.731041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b already deleted. [ 1021.731115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.861505] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1021.861754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.862024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.862303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.862596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.862726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.862806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.863199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.863318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.863412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.863584] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.863686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.863776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.863889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.864098] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.864213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.864213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.864391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.864463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.864515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.864604] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.865605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.865785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.865934] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.866058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.866154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.866394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.866483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.866586] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.973746] env[65162]: INFO networking_nsxv3.common.synchronization [req-c96c302c-8744-4652-b9d6-09b59259081e req-8289571e-d98b-4457-890c-a11a4b66c66a tempest-ServersTestJSON-1771662425 tempest-ServersTestJSON-1771662425-project-member] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_members [ 1021.974995] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGHEST for action security_group_members [ 1021.974995] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.974995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.974995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.975282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.975321] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.975401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.975462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.975625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.975715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.976156] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.109718] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.109965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.109965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.110209] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.110362] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.110517] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda not found, creating... [ 1022.110791] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.110948] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.111073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.111311] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.111889] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.111889] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.112081] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.112193] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.112430] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.112579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.112780] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda is going to be created. [ 1022.138832] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.138946] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.139178] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.139509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.139913] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.140208] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.368409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98741f74-4767-46bd-99a2-76cd0a555e4d: rpc.has_security_group_logging(os_id): False [ 1022.369681] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.388141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.388316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.388417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.388618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.388711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.388909] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.389052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.389106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.389255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.389306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.389464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.389558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.389617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.389752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.389825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.390024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.390117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.390204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.390405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.390519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.390618] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be created. [ 1022.456984] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.457201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.457201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.457382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.457575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.470701] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1022.478132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.478366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.478366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.478580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.478688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.478890] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.479064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.479064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.479227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.479303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.479399] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 is going to be updated. [ 1022.511431] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.511431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.511431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.511685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.511875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.521023] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a35add5-dafe-4fde-989e-70f334050fa8 in Status: IN_PROGRESS for 2s [ 1022.871827] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.903176] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bdb008b-1dbf-4e89-a395-ddb6686d1c10 req-28c0fa55-4f89-4338-9b68-55c747b84e47 service nova] Enqueued Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_rules [ 1022.903357] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bdb008b-1dbf-4e89-a395-ddb6686d1c10 req-28c0fa55-4f89-4338-9b68-55c747b84e47 service nova] Enqueued Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_members [ 1022.903494] env[65162]: INFO networking_nsxv3.common.synchronization [req-3bdb008b-1dbf-4e89-a395-ddb6686d1c10 req-28c0fa55-4f89-4338-9b68-55c747b84e47 service nova] Enqueued Resource ID: 932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda with Priority: HIGHEST for action port [ 1022.904017] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_rules [ 1022.904186] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_members [ 1022.904299] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda with Priority: HIGHEST for action port [ 1022.904592] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.904693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.904762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.905045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.906835] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.907070] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.907196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.907280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.907808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.907956] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.908064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.908125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.908839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.908839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.908839] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.910732] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.910732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.910732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.910890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.910890] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.014200] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 1023.014528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.374590] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.374792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.374864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.375126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.375220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.375325] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1023.408046] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.408250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.408364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.408700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.408928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.410360] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.410572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.412530] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.415913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda with status ACTIVE [ 1023.415913] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.415913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.415913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.416252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.416355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.416846] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.416958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.417036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.417260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.417356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.417680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.417778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.417846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.418063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.418122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.418166] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda is going to be updated. [ 1023.420765] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1023.440116] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.440352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.440352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.440534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.440706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.440868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932a77d7-d1a0-4d7d-ba1d-bb15eaf07bda" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.836853] env[65162]: INFO networking_nsxv3.common.synchronization [req-6f812b25-f170-4e49-94ab-9ee08cadae60 req-44aa1eb2-3075-401f-8dfc-88bc2fd48ad2 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1023.837866] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1023.838288] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.838484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.838570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.838767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.838927] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.839115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.839225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.839431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.839530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.839797] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.920487] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.207202] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.208037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.208037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.208037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.208277] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.208511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.208721] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.208988] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.209193] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.209527] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.209648] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.209758] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.209939] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.210155] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.210278] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.210412] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.231125] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.231329] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.231467] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.231779] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.232221] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-cf5214d9-9727-4694-bdf4-d976c498f891 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.232393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.232564] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.233037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.233191] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf5214d9-9727-4694-bdf4-d976c498f891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.342069] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.342302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.342302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.342509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.365492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.366070] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.366070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.366070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.366282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.366404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.366522] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1024.396721] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.396900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.397037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.397225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.397463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.409815] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1024.422475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.423053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.423053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.423053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.423318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.423318] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b is going to be created. [ 1024.466477] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.466741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.466871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.467089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.467370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.487876] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b in Status: UNINITIALIZED for 2s [ 1024.493589] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1024.493844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.494498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.494498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.494498] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.531219] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a35add5-dafe-4fde-989e-70f334050fa8 in Status: SUCCESS [ 1024.531427] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 deletion is rescheduled due to dependency. [ 1024.531538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.736441] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.736714] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.736914] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.737350] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.737558] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.737768] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port cf5214d9-9727-4694-bdf4-d976c498f891 not found, creating... [ 1024.738203] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.738375] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.738594] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.738818] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.739065] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.739479] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.739703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.739879] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.740205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.740328] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.740520] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: cf5214d9-9727-4694-bdf4-d976c498f891 is going to be created. [ 1024.764524] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.764811] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.764985] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.765341] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.765713] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.766154] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.997152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.997152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.436146] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1025.436146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.436146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.436397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.436599] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.436743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.436812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.436987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.437089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.437201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.437310] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.499091] env[65162]: INFO networking_nsxv3.common.synchronization [req-6f812b25-f170-4e49-94ab-9ee08cadae60 req-ac191ab6-2074-4069-9887-42f4cb680b28 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1025.499383] env[65162]: INFO networking_nsxv3.common.synchronization [req-6f812b25-f170-4e49-94ab-9ee08cadae60 req-ac191ab6-2074-4069-9887-42f4cb680b28 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1025.499550] env[65162]: INFO networking_nsxv3.common.synchronization [req-6f812b25-f170-4e49-94ab-9ee08cadae60 req-ac191ab6-2074-4069-9887-42f4cb680b28 service nova] Enqueued Resource ID: cf5214d9-9727-4694-bdf4-d976c498f891 with Priority: HIGHEST for action port [ 1025.500564] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1025.500637] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1025.501753] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5214d9-9727-4694-bdf4-d976c498f891 with Priority: HIGHEST for action port [ 1025.501753] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.501753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.501753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.501753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.502239] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.504139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.504139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.504139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf5214d9-9727-4694-bdf4-d976c498f891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.504806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.504959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.505635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.505635] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf5214d9-9727-4694-bdf4-d976c498f891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.898092] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1025.898092] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:2 started [ 1025.940185] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.940362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.940421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.940723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.940929] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.941091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.941183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.941373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.941611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.941611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.941802] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.941918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.942010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.942224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.942415] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.942503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.942558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.942746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.942850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.942960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.943243] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.007480] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.007952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.007952] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf5214d9-9727-4694-bdf4-d976c498f891 with status ACTIVE [ 1026.008106] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.008234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.008320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.008646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.008753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.008947] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.009102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.009175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.009338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.009419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.009643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.009714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.009804] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.009982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.010083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.010150] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf5214d9-9727-4694-bdf4-d976c498f891 is going to be updated. [ 1026.052433] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.052620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.052620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.053196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.053196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.053365] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf5214d9-9727-4694-bdf4-d976c498f891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.423556] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1026.423794] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e deletion is rescheduled due to dependency. [ 1026.423998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.424188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.424547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.424780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.424939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.425046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.425306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.425460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.425629] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.447083] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98741f74-4767-46bd-99a2-76cd0a555e4d: rpc.has_security_group_logging(os_id): False [ 1026.470921] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.471138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.471241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.471481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.471590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.471865] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.471999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.472080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.472347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.472469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.472689] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.472801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.472886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.473080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.473166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.473401] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.473513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.473596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.473861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.473861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.474030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1026.500692] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b in Status: SUCCESS [ 1026.500979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.501505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.502093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.502093] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.502093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.502093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.502272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.502328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.502463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.502581] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.554282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.554687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.554805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.555094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.555260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.576460] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1026.927731] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.005533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.005659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.005737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.006361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.006596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.006747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.006835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.007042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.007137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.007245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.007426] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.007536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.007763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.007862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.008199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.008294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.008332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.008605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.008710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.008799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.009252] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.430972] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.512069] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 669aed0f-0b7f-4e96-9c95-c67fdbc3580b: rpc.has_security_group_logging(os_id): False [ 1027.534622] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.534774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.534832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.535057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.535147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.535334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.535430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.535492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.535637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.535713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.535901] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.535992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.536064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.536198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.536329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.536515] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.536606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.536665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.536802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.536875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.536958] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b is going to be created. [ 1027.664547] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.664723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.664799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.665064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.665783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.677819] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b in Status: IN_PROGRESS for 2s [ 1027.933568] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.933781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.933918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.934043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.934137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.934243] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1027.981077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.981251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.981309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.981564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.981719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.992969] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1028.592057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1028.592357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.592519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.592767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.592856] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.095455] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.095455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.095727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.095768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.096373] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.096516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.096576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.096699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.096787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.096877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.096967] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.599634] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.599984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.599984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.600082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.601019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.601019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.601019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.601019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.601019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.601019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.601019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.601340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.601340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.601413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.601769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.601769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.601769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.601898] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.601963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.602062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.602152] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.690813] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b in Status: SUCCESS [ 1029.691066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.005768] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1030.006059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.006251] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.006566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.006770] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.006890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.006957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.007133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.007218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.007307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.007443] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.104627] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98741f74-4767-46bd-99a2-76cd0a555e4d: rpc.has_security_group_logging(os_id): False [ 1030.122882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.123087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.123145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.123418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.123520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.123757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.123887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.123995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.124154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.124239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.124438] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.124527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.124585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.124725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.124940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.124982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.125107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.125144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.125271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.125343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.125429] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1030.192329] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.192641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.192641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.192754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.192989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.209234] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1030.419272] env[65162]: INFO networking_nsxv3.common.synchronization [None req-f0399c3f-333b-4c62-9066-eefa846ee031 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1030.419907] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1030.419907] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.419907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.419907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.420178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.421652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.421652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.421652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.421652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.421652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.421652] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.509936] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.510492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.923104] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.425396] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.862106] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-a2e5f317-2e67-4a4c-965f-d2538104e19c tempest-ListServersNegativeTestJSON-360776762 tempest-ListServersNegativeTestJSON-360776762-project-member] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1031.862670] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1031.862973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.863148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.863274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.863449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.863605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.863708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.863854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.864073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.864161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.864287] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.929054] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.929472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.929472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.929550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.929670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.929765] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1031.963020] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.963194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.963278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.963534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.963620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.975579] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1032.223992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1032.224267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.238191] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.238446] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.238646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.238945] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.239268] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.239463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.239589] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.239843] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.240037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.240249] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.240375] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.240487] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.240595] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.240703] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.240808] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.241048] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.263805] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.263805] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.263805] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.263805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.263805] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-486b425f-103a-4434-92f5-0b81b9ebaf12 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.263805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.263805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.264692] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.264904] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('486b425f-103a-4434-92f5-0b81b9ebaf12',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.368425] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.369548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.370265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.370579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.370773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.371136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.371383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.371539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.371789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.371960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.372147] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 already deleted. [ 1032.372404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.683877] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.683877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.683877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.683877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.684171] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.684171] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.684272] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.684522] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.684674] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.684882] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.684993] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.685113] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.685220] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.685324] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.685428] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.685567] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.705385] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.705615] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.705615] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.705830] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.706127] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-b80fb887-fad2-47b1-8a1a-85e8611dc942 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.706304] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.706446] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.706795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.706936] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80fb887-fad2-47b1-8a1a-85e8611dc942',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.768858] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.769146] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.769252] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.769645] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.769811] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.769976] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 486b425f-103a-4434-92f5-0b81b9ebaf12 not found, creating... [ 1032.770277] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.770446] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.770566] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.770793] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.770950] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.771243] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.771393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.771510] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.771709] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.771841] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.771975] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 486b425f-103a-4434-92f5-0b81b9ebaf12 is going to be created. [ 1032.803579] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.804015] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.804263] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.804729] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.805089] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.805428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.210068] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.210068] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.210546] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.210546] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.210720] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.210778] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port b80fb887-fad2-47b1-8a1a-85e8611dc942 not found, creating... [ 1033.211075] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.211241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.211359] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.211605] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.211754] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.212043] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.212200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.212317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.212871] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.212871] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.212871] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: b80fb887-fad2-47b1-8a1a-85e8611dc942 is going to be created. [ 1033.236070] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.236325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.236630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.236934] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.237121] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.237221] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.502908] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-1f5f1397-ab39-4507-b62b-91e5f99ca524 service nova] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_rules [ 1033.503096] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-1f5f1397-ab39-4507-b62b-91e5f99ca524 service nova] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1033.503231] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-1f5f1397-ab39-4507-b62b-91e5f99ca524 service nova] Enqueued Resource ID: 486b425f-103a-4434-92f5-0b81b9ebaf12 with Priority: HIGHEST for action port [ 1033.503728] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_rules [ 1033.503882] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1033.503989] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 486b425f-103a-4434-92f5-0b81b9ebaf12 with Priority: HIGHEST for action port [ 1033.504651] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.505638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.505638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.505638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.505638] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.506759] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.508388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.510627] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.510627] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.510627] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-486b425f-103a-4434-92f5-0b81b9ebaf12 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.510627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.510627] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('486b425f-103a-4434-92f5-0b81b9ebaf12',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.959838] env[65162]: INFO networking_nsxv3.common.synchronization [req-b6c6b847-fe61-4880-9e20-f6ad03175ddf req-ded79167-4380-4ed4-8faf-bd9f5932f61e service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1033.960110] env[65162]: INFO networking_nsxv3.common.synchronization [req-b6c6b847-fe61-4880-9e20-f6ad03175ddf req-ded79167-4380-4ed4-8faf-bd9f5932f61e service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1033.960227] env[65162]: INFO networking_nsxv3.common.synchronization [req-b6c6b847-fe61-4880-9e20-f6ad03175ddf req-ded79167-4380-4ed4-8faf-bd9f5932f61e service nova] Enqueued Resource ID: b80fb887-fad2-47b1-8a1a-85e8611dc942 with Priority: HIGHEST for action port [ 1033.960750] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1033.960970] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1033.961108] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b80fb887-fad2-47b1-8a1a-85e8611dc942 with Priority: HIGHEST for action port [ 1033.961387] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.961504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.961769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.961824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.961966] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b80fb887-fad2-47b1-8a1a-85e8611dc942 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.962094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.962208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.962398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.962519] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80fb887-fad2-47b1-8a1a-85e8611dc942',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.987269] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1033.987269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.987447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.987718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.987963] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.988068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.988175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.988295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.988391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.988485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.988690] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.988793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.988856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.989024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.989258] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.989327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.989414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.989500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.989575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.989675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.989764] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.990609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.990773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.990920] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.991049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.991114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.991255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.991329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.991416] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.013104] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.013104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.013104] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.013396] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 486b425f-103a-4434-92f5-0b81b9ebaf12 with status ACTIVE [ 1034.013531] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.013646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.013711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.013917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.014015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.014186] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.014289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.014423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.014530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.014609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.014848] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.014953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.015132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.015300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.015458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.015552] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 486b425f-103a-4434-92f5-0b81b9ebaf12 is going to be updated. [ 1034.042902] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.043113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.043223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.043450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.044905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.044905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-486b425f-103a-4434-92f5-0b81b9ebaf12" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.383057] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-e126e7d1-73eb-4b97-aa12-593fcfa8fa88 tempest-ListServersNegativeTestJSON-360776762 tempest-ListServersNegativeTestJSON-360776762-project-member] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1034.383057] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1034.383057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.383057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.465103] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b80fb887-fad2-47b1-8a1a-85e8611dc942 with status ACTIVE [ 1034.465346] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.465489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.465568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.465809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.465903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.466104] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.466206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.466269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.466447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.466526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.466707] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.466803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.466901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.467014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.467089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.467175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b80fb887-fad2-47b1-8a1a-85e8611dc942 is going to be updated. [ 1034.492334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.492481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.492546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.492756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.492912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.493092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b80fb887-fad2-47b1-8a1a-85e8611dc942" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.493312] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.494661] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7fd6bec-6820-40d4-9564-ee5cb9c2521e: rpc.has_security_group_logging(os_id): False [ 1034.518778] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.518930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.519009] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.519225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.519315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.519564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.519694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.519747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.519879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.519957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.520145] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.520240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.520301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.520440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.520516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.521141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.521282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.521335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.521486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.521566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.521673] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1034.523727] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.626646] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.627795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.627795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.628060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.628060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.658370] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1034.817407] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.817643] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.817766] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.818087] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.818371] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.818537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.818733] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.818989] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.820713] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.820713] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.820713] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.820713] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.820713] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.820713] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.820713] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.821151] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.867690] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.869979] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.869979] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.869979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.869979] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.869979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.869979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.869979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.869979] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.998474] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.026473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.026813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.026929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.027178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.027288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.027488] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be created. [ 1035.054168] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.054332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.054385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.054652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.054839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.067425] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: UNINITIALIZED for 2s [ 1035.372901] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.373144] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.373277] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.373564] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.373796] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.373981] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c not found, creating... [ 1035.374266] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.374430] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.374538] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.374764] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.374905] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.375196] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.375349] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.375463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.375670] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.375805] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.375940] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c is going to be created. [ 1035.399255] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.399255] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.399255] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.399780] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.399780] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.399913] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.502166] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.502339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.502415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.502643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.502737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.502850] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1035.553692] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.553959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.553959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.554117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.554264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.563894] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1036.107284] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-0b761714-0203-4c7c-b9cd-6a89a0eb3fab service nova] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_rules [ 1036.107284] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-0b761714-0203-4c7c-b9cd-6a89a0eb3fab service nova] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1036.107284] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-0b761714-0203-4c7c-b9cd-6a89a0eb3fab service nova] Enqueued Resource ID: cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c with Priority: HIGHEST for action port [ 1036.107284] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_rules [ 1036.107284] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1036.107284] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c with Priority: HIGHEST for action port [ 1036.107284] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.107284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.107284] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.107284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.107898] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.108189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.108382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.108795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.110099] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.611714] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c with status ACTIVE [ 1036.611714] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.611714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.612110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.612110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.612110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.612280] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.612381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.612446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.612601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.612677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.612858] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.612956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.613065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.613221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.613296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.613383] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c is going to be updated. [ 1036.635537] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.635730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.635773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.635974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.636176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.636283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc10e458-d5cc-44e5-98f4-f9c0ab0d3a1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.673784] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1036.674030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.674218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.674452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.674553] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.006033] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-a8f66fba-2a03-46b2-9e81-e07ade9fd328 tempest-ListServersNegativeTestJSON-360776762 tempest-ListServersNegativeTestJSON-360776762-project-member] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1037.006698] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1037.007086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.007292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.073762] env[65162]: INFO networking_nsxv3.common.synchronization [None req-4313b474-eed9-48b0-a138-aad8c74c9601 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_rules [ 1037.076494] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_rules [ 1037.076494] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.076494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.076494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.076494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.076494] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.082770] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1037.083148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.086203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.086203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.086340] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.086500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.086570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.086731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.090022] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.090022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.090022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.090521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.090521] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.176845] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.177304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.197700] env[65162]: INFO networking_nsxv3.common.synchronization [None req-11b2e90d-3d87-4d86-b4b3-636ca7647d4c tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_rules [ 1037.198675] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_rules [ 1037.199180] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.199180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.431419] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.431627] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.431759] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.432095] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.432395] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.432560] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.432698] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.432967] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.433129] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.433342] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.433457] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.433568] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.433676] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.433785] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.433889] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.434083] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.452666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.452881] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.452970] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.453256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-731" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.453610] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-954d6584-bf44-4629-8943-0b92f45a9fdc taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.453832] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.453979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.454317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.454447] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954d6584-bf44-4629-8943-0b92f45a9fdc',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.574898] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1037.575222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.575430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.575625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.575820] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.575940] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.576020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.576177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.576257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.576344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.576456] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.592862] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.592862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.592862] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.596804] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.596951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.596951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.597134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.597221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.597317] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a already deleted. [ 1037.597594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.598057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.598234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.598322] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.957081] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.957500] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.957500] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.957810] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.958021] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.958225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 954d6584-bf44-4629-8943-0b92f45a9fdc not found, creating... [ 1037.958578] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.958794] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.958953] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.959277] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.959481] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.959845] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.960047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.960201] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.960469] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.960619] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.960782] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 954d6584-bf44-4629-8943-0b92f45a9fdc is going to be created. [ 1037.984185] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.984454] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.984636] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.984951] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.985241] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.985524] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.079583] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.079794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.079794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.080041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.080217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.080332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.080401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.080560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.080651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.080740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.080891] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.080984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.081056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.081200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.081345] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.081460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.081524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.081714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.081794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.081881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.082087] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.095479] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.121302] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.121462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.121618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.121739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.121824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.121929] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a already deleted. [ 1038.122021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.585297] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7fd6bec-6820-40d4-9564-ee5cb9c2521e: rpc.has_security_group_logging(os_id): False [ 1038.598504] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.598716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.598827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.599139] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.599267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.599432] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1038.606336] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.606651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.606651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.606905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.607051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.607363] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.607536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.607608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.607768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.607848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.608195] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.608341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.608467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.608663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.608800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.609048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.609941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.610078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.610304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.610413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.610531] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1038.646351] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.646570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.646649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.646909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.647086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.657719] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1038.690664] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.690918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.690918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.691137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.691257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.726199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1038.738688] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-6ff1bbff-cc68-4273-a1f3-ef5010a36913 service nova] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_rules [ 1038.738849] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-6ff1bbff-cc68-4273-a1f3-ef5010a36913 service nova] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1038.738979] env[65162]: INFO networking_nsxv3.common.synchronization [req-d52acc40-fdac-478a-943c-31f372ed2013 req-6ff1bbff-cc68-4273-a1f3-ef5010a36913 service nova] Enqueued Resource ID: 954d6584-bf44-4629-8943-0b92f45a9fdc with Priority: HIGHEST for action port [ 1038.739235] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_rules [ 1038.739369] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1038.739466] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d6584-bf44-4629-8943-0b92f45a9fdc with Priority: HIGHEST for action port [ 1038.740080] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.740142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.740342] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.740451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.740673] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-954d6584-bf44-4629-8943-0b92f45a9fdc taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.740761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.740761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.740943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.741033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954d6584-bf44-4629-8943-0b92f45a9fdc',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.242316] env[65162]: INFO networking_nsxv3.common.synchronization [req-7428c1da-4fe8-4760-b28a-8753ab27c2ca req-a06fe369-4369-4343-b481-023a08449045 tempest-ImagesTestJSON-1244765920 tempest-ImagesTestJSON-1244765920-project-member] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 1039.243014] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGHEST for action security_group_members [ 1039.243611] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 954d6584-bf44-4629-8943-0b92f45a9fdc with status ACTIVE [ 1039.245920] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.247990] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.247990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.248596] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.248596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.248596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.248596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.248596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.248596] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 954d6584-bf44-4629-8943-0b92f45a9fdc is going to be updated. [ 1039.249944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.250070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.250146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.251137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.251137] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.251137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.251137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.251137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.251137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.251137] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.300621] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.300621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.300621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.300621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.300621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.300980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-954d6584-bf44-4629-8943-0b92f45a9fdc" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.756577] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.756750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.756852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.757051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.757145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.757348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.757441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.757508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.758157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.758335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.758437] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be updated. [ 1039.798468] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.798776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.798776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.799020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.799020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.810247] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: IN_PROGRESS for 2s [ 1039.985321] env[65162]: INFO networking_nsxv3.common.synchronization [req-fe7a3297-6efd-4e5d-a7d3-0ef53516933f req-c32634e9-5f65-43b1-ac6a-390f440bef01 tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_members [ 1039.985918] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGHEST for action security_group_members [ 1039.986360] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.986538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.986615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.986921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.987089] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.987187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.987271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.987661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.987661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.987661] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.495027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.495027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.495027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.495027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.517319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.517587] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.517717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.517780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.517988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.518064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.518161] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 is going to be updated. [ 1040.553215] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.553388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.553464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.553673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.553820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.575034] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: IN_PROGRESS for 2s [ 1040.678175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.680572] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.680572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.680572] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.766942] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1040.766942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.183026] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.686073] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.821229] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e in Status: SUCCESS [ 1041.821413] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e deletion is rescheduled due to dependency. [ 1041.821533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.132218] env[65162]: INFO networking_nsxv3.common.synchronization [None req-de1b1efb-bbf3-4273-9a2b-fbff6120ce53 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 1df4616e-00dd-4ce6-a1fd-b007615f31b5 with Priority: HIGHEST for action security_group_rules [ 1042.132218] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1df4616e-00dd-4ce6-a1fd-b007615f31b5 with Priority: HIGHEST for action security_group_rules [ 1042.132407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.132459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.132508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.132853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.132853] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1df4616e-00dd-4ce6-a1fd-b007615f31b5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.188369] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.188510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.188575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.188801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.188900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.191957] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1042.218799] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.218984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.219039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.219249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.219372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.229326] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1042.232855] env[65162]: INFO networking_nsxv3.common.synchronization [None req-c8bcf44a-03bf-4853-a427-6de83bbab9b9 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 1df4616e-00dd-4ce6-a1fd-b007615f31b5 with Priority: HIGHEST for action security_group_rules [ 1042.233409] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1df4616e-00dd-4ce6-a1fd-b007615f31b5 with Priority: HIGHEST for action security_group_rules [ 1042.233721] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.233894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.588679] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 in Status: SUCCESS [ 1042.588881] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 deletion is rescheduled due to dependency. [ 1042.589014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.659624] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.659826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.659826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.660070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.660179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.660295] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1df4616e-00dd-4ce6-a1fd-b007615f31b5 already deleted. [ 1042.660422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.660536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.660698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.661527] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1df4616e-00dd-4ce6-a1fd-b007615f31b5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.186772] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.187170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.187170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.187261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.187377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.187497] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1df4616e-00dd-4ce6-a1fd-b007615f31b5 already deleted. [ 1043.187600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1df4616e-00dd-4ce6-a1fd-b007615f31b5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.241641] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1044.241641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.241641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.242312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.242312] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.242447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.242447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.242588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.242719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.242783] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.732636] env[65162]: INFO networking_nsxv3.common.synchronization [req-2b26bf4b-4abc-44b2-bf2e-910abf5c59b8 req-f436f011-377e-4c38-b049-5e338e54cd71 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_members [ 1044.733237] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_members [ 1044.733549] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.733698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.733770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.734036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.734199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.734301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.734364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.734518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.734603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.734703] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.747171] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.024438] env[65162]: INFO networking_nsxv3.common.synchronization [req-39793638-beba-4079-a36c-72a05010c0b9 req-8fb55040-6926-4fa3-81f4-fe18f92e7f3f tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1045.025200] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1045.026097] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.026252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.026341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.026570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.026740] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.026851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.026935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.028064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.028064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.028064] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.155332] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.155332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.155332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.155332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.155760] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.156096] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.156343] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.157129] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.157401] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.157793] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.158101] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.159261] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.159261] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.159261] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.159261] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.159261] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.181165] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.181165] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.181165] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.181165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.181165] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.181165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.181165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.181165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.181165] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37edcee8-a0c6-4609-95f0-3d5a0c7bed0e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.241621] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.241621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.242033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.242033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.242033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.242218] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.242328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.242416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.242850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.242850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.242850] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 already deleted. [ 1045.242850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.247274] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.529593] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.684828] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.685265] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.685506] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.685940] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.686209] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.686554] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 37edcee8-a0c6-4609-95f0-3d5a0c7bed0e not found, creating... [ 1045.686906] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.687190] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.687360] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.688059] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.688059] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.688286] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.688504] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.688609] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.688905] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.689251] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.689356] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 37edcee8-a0c6-4609-95f0-3d5a0c7bed0e is going to be created. [ 1045.715863] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.716234] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.716431] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.716807] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.717197] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.717518] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.749662] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.749869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.749869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.750169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.750310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.750520] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1045.810590] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.810790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.810854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.811097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.811219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.831666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1046.032999] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.432812] env[65162]: INFO networking_nsxv3.common.synchronization [req-2b26bf4b-4abc-44b2-bf2e-910abf5c59b8 req-ee0f7574-e0df-48ca-8e8e-11d14a586439 service nova] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_rules [ 1046.433132] env[65162]: INFO networking_nsxv3.common.synchronization [req-2b26bf4b-4abc-44b2-bf2e-910abf5c59b8 req-ee0f7574-e0df-48ca-8e8e-11d14a586439 service nova] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_members [ 1046.433314] env[65162]: INFO networking_nsxv3.common.synchronization [req-2b26bf4b-4abc-44b2-bf2e-910abf5c59b8 req-ee0f7574-e0df-48ca-8e8e-11d14a586439 service nova] Enqueued Resource ID: 37edcee8-a0c6-4609-95f0-3d5a0c7bed0e with Priority: HIGHEST for action port [ 1046.434014] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_rules [ 1046.434281] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_members [ 1046.434430] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edcee8-a0c6-4609-95f0-3d5a0c7bed0e with Priority: HIGHEST for action port [ 1046.434880] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.435093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.435240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.435501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.435620] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.437141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.437245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.437364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.438591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.438824] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.438986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.439130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.439368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.439536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.439681] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.441052] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.441052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.441052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.441269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.441269] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37edcee8-a0c6-4609-95f0-3d5a0c7bed0e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.534461] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.535461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.535596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.535861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.537187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.537343] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1046.567880] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.568115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.568227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.568411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.568613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.584589] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1046.596997] env[65162]: INFO networking_nsxv3.common.synchronization [req-90eaa4a6-db82-41b2-8188-588b0e7b9f1d req-33721788-d5d8-4f73-8686-441d539810ad tempest-ServerMetadataTestJSON-1712406949 tempest-ServerMetadataTestJSON-1712406949-project-member] Enqueued Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_members [ 1046.598265] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGHEST for action security_group_members [ 1046.598265] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.598476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.598516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.598842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.598992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.599154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.599243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.599462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.599584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.599704] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.944495] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.944787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.946167] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37edcee8-a0c6-4609-95f0-3d5a0c7bed0e with status ACTIVE [ 1046.946406] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.946577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.946670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.946922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.947076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.947257] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.947456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.947456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.947650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.947799] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.947924] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.948025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.948088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.948227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.948299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.948383] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37edcee8-a0c6-4609-95f0-3d5a0c7bed0e is going to be updated. [ 1046.950242] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.972016] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.972769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.972769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.973043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.973043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.973488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37edcee8-a0c6-4609-95f0-3d5a0c7bed0e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.060161] env[65162]: INFO networking_nsxv3.common.synchronization [req-c380081e-7ae2-49e8-afbc-4cba5499cd6b req-0efffb5c-ca73-4f7f-9c7f-77477e40ff53 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1047.060161] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1047.060161] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.060442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.060442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.060557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.060641] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.060755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.060819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.060965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.061078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.061176] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.102552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.102771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.102925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.103237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.103887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.104143] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.104221] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.104285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.104455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.104647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.104913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b is going to be updated. [ 1047.149973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.150145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.150217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.150934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.150934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.161370] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b in Status: IN_PROGRESS for 2s [ 1047.454998] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.564210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.564390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.564487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.564808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.564937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.565233] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.565371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.565464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.565721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.565877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.566033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1047.600948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.601236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.601323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.601614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.602171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.611417] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1047.842717] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1047.842846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.842996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.843260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.843498] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.843620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.843690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.843899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.843982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.844059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.844235] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.844828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.844828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.844828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.844981] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.844981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.845084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.845192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.845249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.845372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.845372] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.846278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.846440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.846686] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.846892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.846892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.847124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.847124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.847288] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.957397] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.957702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.957781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.958798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.958798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.958798] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 is going to be created. [ 1047.982544] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.982759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.982759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.982957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.983138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.994446] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: UNINITIALIZED for 2s [ 1048.349804] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 884160b0-aa09-4db4-aad6-b412d510fa72: rpc.has_security_group_logging(os_id): False [ 1048.351131] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.381361] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.382901] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.382901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.382901] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.383732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.383732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.383732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.383732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.383922] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.384047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.384089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.384233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.384528] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.384699] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be created. [ 1048.474460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.474460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.474911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.474911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.475157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.488414] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1048.600996] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1048.601239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.857221] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.172625] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b in Status: SUCCESS [ 1049.172625] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b deletion is rescheduled due to dependency. [ 1049.172625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.360120] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.360265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.360313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.360522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.360648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.360764] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1049.364280] env[65162]: INFO networking_nsxv3.common.synchronization [req-8bc31888-4cfc-49b8-8540-85a24c691145 req-5216c674-b11e-4504-a64f-6e87dd1c6b73 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1049.365390] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1049.365782] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.365942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.365988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.366218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.366405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.366538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.366632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.366861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.367046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.367148] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.399359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.399359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.399359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.399680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.399680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.411562] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1049.625107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1049.625381] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 1049.625483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.835352] env[65162]: INFO networking_nsxv3.common.synchronization [req-0187e9e9-2818-496e-9515-318007ddfcd8 req-a7448e5a-8703-42e7-b76e-e43f146e461b tempest-ListServerFiltersTestJSON-1545369510 tempest-ListServerFiltersTestJSON-1545369510-project-member] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1049.835443] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1049.836541] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.836541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.836541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.836815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.836815] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.836904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.836946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.837695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.837695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.837695] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.869706] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.006239] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: SUCCESS [ 1050.006462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.006672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.006892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.009775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.009775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.009775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.009775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.009775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.009775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.009775] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.131771] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b831301d-d4d6-44ac-bcd4-96c6e91314d9 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1050.132533] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1050.133019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.133495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.340330] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.374160] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.421831] env[65162]: INFO networking_nsxv3.common.synchronization [None req-1b62823c-a1aa-4387-876f-b15a98be69b2 None None] Enqueued Resource ID: de3bfa3c-fa28-47a6-ace2-a28337e9249e with Priority: HIGHEST for action port [ 1050.421831] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de3bfa3c-fa28-47a6-ace2-a28337e9249e with Priority: HIGHEST for action port [ 1050.422090] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-de3bfa3c-fa28-47a6-ace2-a28337e9249e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.422207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de3bfa3c-fa28-47a6-ace2-a28337e9249e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.422272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de3bfa3c-fa28-47a6-ace2-a28337e9249e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.422517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de3bfa3c-fa28-47a6-ace2-a28337e9249e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.422602] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de3bfa3c-fa28-47a6-ace2-a28337e9249e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.501667] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1050.501938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.502536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.502801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.502905] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.512433] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.844750] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.879972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.880954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.881136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.881327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.881413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.881478] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1050.913793] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.914028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.914028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.914254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.914408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.925874] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de3bfa3c-fa28-47a6-ace2-a28337e9249e [ 1050.925874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.925874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.926118] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.926212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.927408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.927408] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de3bfa3c-fa28-47a6-ace2-a28337e9249e already deleted. [ 1050.927408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de3bfa3c-fa28-47a6-ace2-a28337e9249e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.927599] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1051.007876] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.008341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.014792] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0866c18-786e-4157-b82e-c968cd3e4da4: rpc.has_security_group_logging(os_id): False [ 1051.036572] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.037162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.037341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.040026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.040026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.040026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.040026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.040026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.040026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.040026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.040026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 is going to be created. [ 1051.105213] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.105356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.105423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.105621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.105796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.118888] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: IN_PROGRESS for 2s [ 1051.352190] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.352190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.352190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.352190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.352190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.352190] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1051.391038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.391038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.391038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.391038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.391038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.400146] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1051.422043] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1051.423038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.423038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.423038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.423392] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.423392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.423480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.423594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.423677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.423871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.425014] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.589252] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b246fd51-b408-4972-b78a-30aa2d45b380 tempest-ServersV294TestFqdnHostnames-1848219887 tempest-ServersV294TestFqdnHostnames-1848219887-project-member] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_rules [ 1051.589921] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_rules [ 1051.590332] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.590663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.590663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.590965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.590965] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.692871] env[65162]: INFO networking_nsxv3.common.synchronization [None req-3701cfbd-0ecf-477b-825b-4ec260c9382e tempest-ServersV294TestFqdnHostnames-1848219887 tempest-ServersV294TestFqdnHostnames-1848219887-project-member] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_rules [ 1051.692871] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_rules [ 1051.693173] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.693416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.927652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.928066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.928066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.928317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.928571] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.928737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.928834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.929869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.929869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.929869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.929869] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.930153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.930153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.930442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.930646] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.930798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.930899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.931191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.931432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.931432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.931591] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.119581] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.119760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.119901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.120082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.120187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.120316] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b already deleted. [ 1052.120369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.120735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.120735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.120815] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.433892] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 884160b0-aa09-4db4-aad6-b412d510fa72: rpc.has_security_group_logging(os_id): False [ 1052.453972] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.454306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.454306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.454306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.456635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.456635] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.456635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.456635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.456635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.457242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.457620] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.457768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.457851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.458047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.458336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.458336] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.458579] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.458722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.458880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.459036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.459762] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1052.479522] env[65162]: INFO networking_nsxv3.common.synchronization [req-57a1131c-1a8e-4f9b-bf97-249b80b0a555 req-56d97416-ec7e-406d-9deb-442a0a96ddbf tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1052.479944] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1052.481793] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.481979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.482044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.482430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.483769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.483769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.483769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.483769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.483769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.483769] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.523219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.523375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.523426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.523635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.523821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.546410] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1052.654911] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.655218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.655334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.655652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.655773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.655867] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b already deleted. [ 1052.655979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.876646] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.876646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.876646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.876646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.877224] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.877224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.877224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.877491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.879171] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.879171] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.879171] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.879171] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.879171] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.879171] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.879171] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.879171] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.918340] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.919216] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.919382] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.919572] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.919899] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-79630e23-bdf2-4144-b026-6674ebb95dcf taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.920102] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.920222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.920546] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.920685] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79630e23-bdf2-4144-b026-6674ebb95dcf',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.937829] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1052.938144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.938280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.938532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.938781] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.938930] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.939019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.939205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.939464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.939464] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.990242] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.990242] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.990242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.990242] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1053.024077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.024077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.024077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.024077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.024077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.035951] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1053.133113] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: SUCCESS [ 1053.133671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.211224] env[65162]: INFO networking_nsxv3.common.synchronization [None req-9e9ac30b-aaa3-4a5a-8756-af8c82f8eb22 None None] Enqueued Resource ID: 7de0f72e-960f-4698-8a51-922215d5a0e1 with Priority: HIGHEST for action port [ 1053.211224] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7de0f72e-960f-4698-8a51-922215d5a0e1 with Priority: HIGHEST for action port [ 1053.211224] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7de0f72e-960f-4698-8a51-922215d5a0e1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.211224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7de0f72e-960f-4698-8a51-922215d5a0e1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.211586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7de0f72e-960f-4698-8a51-922215d5a0e1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.211958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7de0f72e-960f-4698-8a51-922215d5a0e1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.212180] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de0f72e-960f-4698-8a51-922215d5a0e1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.366408] env[65162]: INFO networking_nsxv3.common.synchronization [req-af938885-638d-4d22-bfca-d9a7ef10b14a req-8babf386-3c41-49ac-b9b1-7dbc8092fb85 tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1053.367297] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1053.367693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.367861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.367938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.368204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.368390] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.368500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.368557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.368760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.368850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.368946] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.411376] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1053.411657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.427952] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.427952] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.427952] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.428551] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.428551] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.428693] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 79630e23-bdf2-4144-b026-6674ebb95dcf not found, creating... [ 1053.429018] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429197] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.429309] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.429544] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.429716] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.430081] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.430293] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.430415] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.430672] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.430855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.431011] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 79630e23-bdf2-4144-b026-6674ebb95dcf is going to be created. [ 1053.441368] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.441513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.441580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.441822] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.441873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.442067] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.442166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.442219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.442435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.442514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.442601] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1053.455151] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.455367] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.455508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.455780] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.456026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.456265] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.474372] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.474575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.474619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.474823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.474968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.483119] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1053.716515] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7de0f72e-960f-4698-8a51-922215d5a0e1 [ 1053.716515] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.716515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.716515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.716515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.716515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.716515] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7de0f72e-960f-4698-8a51-922215d5a0e1 already deleted. [ 1053.716515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7de0f72e-960f-4698-8a51-922215d5a0e1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.872322] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.873730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.873730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.873730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.904711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.904968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.905228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.905228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.905401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.905482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.906737] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1053.941948] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.941948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.941948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.941948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.941948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.954323] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1054.169978] env[65162]: INFO networking_nsxv3.common.synchronization [req-57a1131c-1a8e-4f9b-bf97-249b80b0a555 req-d0c6950f-0d84-4b6f-8edd-858976d4cfb8 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 1054.170172] env[65162]: INFO networking_nsxv3.common.synchronization [req-57a1131c-1a8e-4f9b-bf97-249b80b0a555 req-d0c6950f-0d84-4b6f-8edd-858976d4cfb8 service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1054.170316] env[65162]: INFO networking_nsxv3.common.synchronization [req-57a1131c-1a8e-4f9b-bf97-249b80b0a555 req-d0c6950f-0d84-4b6f-8edd-858976d4cfb8 service nova] Enqueued Resource ID: 79630e23-bdf2-4144-b026-6674ebb95dcf with Priority: HIGHEST for action port [ 1054.170887] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 1054.170930] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1054.171078] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79630e23-bdf2-4144-b026-6674ebb95dcf with Priority: HIGHEST for action port [ 1054.171357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.171539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.171601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.171753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.171833] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.173042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.173170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.173374] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-79630e23-bdf2-4144-b026-6674ebb95dcf taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.173475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.173541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.173712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.173789] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79630e23-bdf2-4144-b026-6674ebb95dcf',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.193869] env[65162]: INFO networking_nsxv3.common.synchronization [req-c7f14d03-7750-48a6-a316-92887daf7f2e req-643939a5-35dc-4db3-8112-571b098c7f4f tempest-ListServersNegativeTestJSON-360776762 tempest-ListServersNegativeTestJSON-360776762-project-member] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1054.194306] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1054.194712] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.194821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.194821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.194992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.199646] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.201321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.201321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.201321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.201321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.201321] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.563369] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1054.563922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.564240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.564593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.564972] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.676716] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.676716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.682561] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79630e23-bdf2-4144-b026-6674ebb95dcf with status ACTIVE [ 1054.682561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.682561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.682561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.682561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.682561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.682561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.682890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.682890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.682890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.682979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.683269] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.683354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.683354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.683501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.683600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.683694] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79630e23-bdf2-4144-b026-6674ebb95dcf is going to be updated. [ 1054.703107] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.710992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.710992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.710992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.710992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.710992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.710992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79630e23-bdf2-4144-b026-6674ebb95dcf" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.046014] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1055.046395] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 1055.046395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.046506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.046762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.046975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.047120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.047188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.047351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.047475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.047679] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.068095] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.068262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.206025] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.493584] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1055.493584] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e deletion is rescheduled due to dependency. [ 1055.493584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.549947] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.710628] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.710845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.710951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.711271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.711398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.711515] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1055.767623] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.767908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.767908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.768167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.768224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.779760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1055.848599] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.848796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.848843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.849072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.849187] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.965053] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1055.965262] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 deletion is rescheduled due to dependency. [ 1055.965349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.052641] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.352979] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.558273] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.558273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.558273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.558273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.558273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.558273] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1056.586065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.588869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.588869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.588869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.588869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.597019] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1056.856942] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.041852] env[65162]: INFO networking_nsxv3.common.synchronization [req-0ad585e4-83b2-4310-8e30-7af74f98fa8b req-50c27867-2d7d-4a4e-8e45-e1e4a1ea10bb tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_members [ 1057.042465] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_members [ 1057.042709] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.042843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.042843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.043705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.043914] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.043993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.044054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.044208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.044297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.044393] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.365290] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1057.365606] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1057.384419] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.384659] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.384799] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.385077] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.385351] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.385497] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.385611] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.385829] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.385976] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.386192] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.386302] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.386781] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.386781] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.386781] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.386781] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.387282] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.405432] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.405667] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.405812] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.405993] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.406316] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-5b7dda48-70c7-4dd3-a934-48d468018e53 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.406491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.406650] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.406994] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.407176] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b7dda48-70c7-4dd3-a934-48d468018e53',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.547063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.547235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.547298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.547516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.547611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.547810] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.547908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.547965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.548133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.548211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.548289] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a already deleted. [ 1057.548367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.809643] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1057.810016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.810289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.810534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.810730] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.810873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.810919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.811110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.811200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.811303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.811397] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.909883] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.910143] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.910267] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.910546] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.910702] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.910935] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 5b7dda48-70c7-4dd3-a934-48d468018e53 not found, creating... [ 1057.911223] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.911393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.911509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.911737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.911873] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.912161] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.912316] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.912428] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.912630] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.912766] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.912906] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 5b7dda48-70c7-4dd3-a934-48d468018e53 is going to be created. [ 1057.939365] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.939664] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.939872] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.940145] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.940378] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.940644] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.310962] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.310962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.310962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.310962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.322692] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1058.323635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.324942] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1058.326167] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.326308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.326375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.326577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.326788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.326894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.326967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.327130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.327211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.327709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.327901] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.328027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.328146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.328250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.328402] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.328492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.328551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.328701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.328781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.328858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.328958] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.361565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.361722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.361795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.362033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.372801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.373516] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1058.373617] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1058.373775] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1058.417191] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.417507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.417507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.417674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.419239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.419457] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1058.502994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.503254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.503301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.503544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.503953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.504265] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1058.606175] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.606344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.607354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.609912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.610054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.610333] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:53. [ 1058.610583] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9524ba2d-0871-4060-bb89-ad3d899c17e8', '4c367c1a-4f7d-4875-9d05-179a78da6584', 'afc090b2-bc85-4f97-aa84-42fe4b3085b7', '1a02c478-9c75-420c-a387-bc52bfa702cb', '57fc90dd-4523-40bd-978d-d9bf1437468c', 'a0866c18-786e-4157-b82e-c968cd3e4da4', 'bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7', '24634bde-1ed8-4d4f-9db6-b19816b628d7', 'e6661d9a-0a2f-4ad7-a804-9e5004aa95db', '98741f74-4767-46bd-99a2-76cd0a555e4d', '8d4deebf-95e4-4bfd-963f-b8c408668b1c', '3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f', '4dd59e3c-797c-4664-8f76-fa18f1a811b1', 'dcdff5a2-f30c-4336-a8cd-e116d208fd7d', 'db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb', '8253b890-33c3-4c25-961c-e88cce1b8eff', 'f119f3ea-37d4-4fbd-902f-2e9a18c9729b', 'a7fd6bec-6820-40d4-9564-ee5cb9c2521e', '2cf3edd7-c692-47b8-9058-7c2d873d8056', '2e983155-2c0f-440c-885b-2648c7ee2a33', '542ab4ea-1934-47eb-b35d-a11a9e723c30', 'f2880f64-bee4-45fb-88ef-a60ad0c676d2', 'b55eb5d3-a252-4f36-9046-1505d8f8fa4e', '8402ae4d-ae29-4339-9c47-47671f8a297d', '61d6cfb7-70e3-40e9-910e-91206aa6d806', '03c457f4-5193-48c8-99b4-9dd3e8a1a23d', '47ef750e-5b63-4b25-85ba-13ff2b01aab2', '56db26ed-c49a-44f4-95c8-7daf9b19435e', 'd8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c', '9750e22b-5fab-447f-83f8-693fd5c74e09', 'f86c44d7-d532-4841-9243-c4031dd1f02d', '669aed0f-0b7f-4e96-9c95-c67fdbc3580b', '9998726b-c2cc-495a-9b94-43b9da32545d', '7f84ca5c-ce92-4db5-9d7f-838f30c85f1f', 'f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5', 'dda58912-2918-4cc8-9735-fc69849b0476', '523df74a-7dca-4c8d-a869-891ca0abbe71', '3335dfc0-bd35-4429-ae08-fe5e4847acff', '7caef476-012f-4313-ac05-e9388bfdc717', '9277ea7b-0e9f-4304-afc4-0c02fdc31f78', 'd813c855-9a5b-4789-b322-fc73fc195c5d', '19a33b05-c764-41fc-b486-255a775ecff1', 'cc14b794-c440-4406-844c-ac39d23312a4', '1a35add5-dafe-4fde-989e-70f334050fa8', 'be9d78f4-56f5-4314-9b4c-a33024af1fa8', 'dd94e034-7289-4a18-8431-d4bba42b0823', 'a29ad06f-d3bc-443d-9727-1f7cc59ff50a', '7b521adf-a3c4-47a4-a31d-e406ca77ccb7', '2f904e96-f18d-4ef1-be07-0c2f77a78a73', 'a8d82595-19fb-4678-9933-9ad14fdf5ab6', '76494ce4-3ed0-426c-ac36-271f9eef282c', '884160b0-aa09-4db4-aad6-b412d510fa72', 'ec0acf84-468d-4a9a-80be-4595d495629a'} {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1058.610583] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1058.612088] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1058.612315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.612791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.612982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.613171] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.613295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.613362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.613502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.613583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.613710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.613833] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.631203] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.631577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.631835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.632201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.632396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.632590] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1058.632831] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1058.633013] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1058.646088] env[65162]: INFO networking_nsxv3.common.synchronization [req-0ad585e4-83b2-4310-8e30-7af74f98fa8b req-e74c7b09-7c53-4aee-9729-5183c369be2f service nova] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_rules [ 1058.647732] env[65162]: INFO networking_nsxv3.common.synchronization [req-0ad585e4-83b2-4310-8e30-7af74f98fa8b req-e74c7b09-7c53-4aee-9729-5183c369be2f service nova] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_members [ 1058.647732] env[65162]: INFO networking_nsxv3.common.synchronization [req-0ad585e4-83b2-4310-8e30-7af74f98fa8b req-e74c7b09-7c53-4aee-9729-5183c369be2f service nova] Enqueued Resource ID: 5b7dda48-70c7-4dd3-a934-48d468018e53 with Priority: HIGHEST for action port [ 1058.648123] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_rules [ 1058.648418] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_members [ 1058.648521] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b7dda48-70c7-4dd3-a934-48d468018e53 with Priority: HIGHEST for action port [ 1058.648819] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.649019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.649106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.649383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.649509] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.651067] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.651264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.651423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.651574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.651742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.652297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.652437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.652646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.652755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.652858] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.654353] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b7dda48-70c7-4dd3-a934-48d468018e53 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.654740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.654740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.654880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.654992] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b7dda48-70c7-4dd3-a934-48d468018e53',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.731138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.731370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.731420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.732014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.732890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.733213] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1058.733322] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1058.733476] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1058.733591] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1058.733704] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/53 resources of Type:Security Group Rules [ 1058.733811] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGH for action security_group_rules [ 1058.733851] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGH for action security_group_rules [ 1058.733946] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGH for action security_group_rules [ 1058.734014] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGH for action security_group_rules [ 1058.734085] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGH for action security_group_rules [ 1058.734085] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGH for action security_group_rules [ 1058.734085] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGH for action security_group_rules [ 1058.734474] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGH for action security_group_rules [ 1058.734474] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGH for action security_group_rules [ 1058.734474] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGH for action security_group_rules [ 1058.734628] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGH for action security_group_rules [ 1058.734628] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGH for action security_group_rules [ 1058.734628] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGH for action security_group_rules [ 1058.734749] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGH for action security_group_rules [ 1058.734783] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGH for action security_group_rules [ 1058.734889] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGH for action security_group_rules [ 1058.734979] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGH for action security_group_rules [ 1058.735087] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGH for action security_group_rules [ 1058.735087] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGH for action security_group_rules [ 1058.735233] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGH for action security_group_rules [ 1058.735291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.831442] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 884160b0-aa09-4db4-aad6-b412d510fa72: rpc.has_security_group_logging(os_id): False [ 1058.850533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.850693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.850758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.850973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.870032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.870287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.870412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.870485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.870677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.870757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.870958] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.871072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.871133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.871277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.871364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.871545] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.871632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.871695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.871834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.871922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.872021] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1058.931705] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.931853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.931928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.932155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.932297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.949559] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1059.116262] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.116418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.116491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.116748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.116924] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.117061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.117124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.117285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.117371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.117460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.117606] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.117723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.117867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.117969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.118111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.118198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.118296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.118391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.118456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.118537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.118624] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.158440] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.158595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.159131] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.159594] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b7dda48-70c7-4dd3-a934-48d468018e53 with status ACTIVE [ 1059.159783] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.159927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.159992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.160206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.160328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.160459] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.160554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.160620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.160764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.160842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.161555] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.161697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.161768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.161945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.162123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.162210] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b7dda48-70c7-4dd3-a934-48d468018e53 is going to be updated. [ 1059.164438] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7388d4-4454-493b-bd68-d6b486d17295 req-2ebf97d2-0b86-4369-bb44-a3371ebb4294 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_members [ 1059.165535] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGHEST for action security_group_members [ 1059.165636] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 with Priority: HIGH for action security_group_rules [ 1059.165744] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 with Priority: HIGH for action security_group_rules [ 1059.165844] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 with Priority: HIGH for action security_group_rules [ 1059.165945] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb with Priority: HIGH for action security_group_rules [ 1059.166199] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGH for action security_group_rules [ 1059.166336] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGH for action security_group_rules [ 1059.166437] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGH for action security_group_rules [ 1059.166530] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b with Priority: HIGH for action security_group_rules [ 1059.166621] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d with Priority: HIGH for action security_group_rules [ 1059.166768] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8253b890-33c3-4c25-961c-e88cce1b8eff with Priority: HIGH for action security_group_rules [ 1059.167057] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 with Priority: HIGH for action security_group_rules [ 1059.167172] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f with Priority: HIGH for action security_group_rules [ 1059.167265] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c with Priority: HIGH for action security_group_rules [ 1059.167353] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGH for action security_group_rules [ 1059.167441] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db with Priority: HIGH for action security_group_rules [ 1059.167533] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGH for action security_group_rules [ 1059.167663] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 with Priority: HIGH for action security_group_rules [ 1059.167784] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc90dd-4523-40bd-978d-d9bf1437468c with Priority: HIGH for action security_group_rules [ 1059.167895] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 with Priority: HIGH for action security_group_rules [ 1059.168158] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGH for action security_group_rules [ 1059.168874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.169227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.169318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.169440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.169610] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.169938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.170010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.170604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.170710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.170803] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.172134] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9524ba2d-0871-4060-bb89-ad3d899c17e8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.172250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.172321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.172459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.172539] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9524ba2d-0871-4060-bb89-ad3d899c17e8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.175897] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.175897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.175897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.176088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.176132] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afc090b2-bc85-4f97-aa84-42fe4b3085b7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.176880] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.176997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.177067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.177257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.177345] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.177961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.179638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.179725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.179888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.179962] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.180678] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.180807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.180846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.181137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.181274] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.182255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.183252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.183252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.183252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.183403] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.184071] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.184167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.185384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.185384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.185384] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.186952] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.186952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.186952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.186952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.187404] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f119f3ea-37d4-4fbd-902f-2e9a18c9729b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.188213] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.188340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.188419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.188536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.188606] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcdff5a2-f30c-4336-a8cd-e116d208fd7d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.189477] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8253b890-33c3-4c25-961c-e88cce1b8eff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.190296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.190362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.190581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.190581] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8253b890-33c3-4c25-961c-e88cce1b8eff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.191502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.191678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.191745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.191908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.191991] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd59e3c-797c-4664-8f76-fa18f1a811b1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.193530] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.193648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.193707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.194199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.194278] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.195761] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.195892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.195955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.196095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.196173] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4deebf-95e4-4bfd-963f-b8c408668b1c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.196847] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.196957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.197035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.197180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.197248] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.198195] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.198312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.198821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.199626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.199878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6661d9a-0a2f-4ad7-a804-9e5004aa95db',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.202192] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.202351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.202402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.202534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.202871] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.203337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24634bde-1ed8-4d4f-9db6-b19816b628d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.203453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.203508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.203643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.203707] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24634bde-1ed8-4d4f-9db6-b19816b628d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.205255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57fc90dd-4523-40bd-978d-d9bf1437468c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.205491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.205491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.205662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.205662] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57fc90dd-4523-40bd-978d-d9bf1437468c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.206302] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c367c1a-4f7d-4875-9d05-179a78da6584 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.206413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.206488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.206605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.206672] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c367c1a-4f7d-4875-9d05-179a78da6584',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.208033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.208033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.208033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.208033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.208033] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.209499] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.209640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.209707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.211067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.211067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.211067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b7dda48-70c7-4dd3-a934-48d468018e53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.213619] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.213745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.213801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.213941] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.244467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.244467] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.244467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.244467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.244924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.244924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.244924] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 is going to be updated. [ 1059.268030] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.268030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.268030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.268030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.270376] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.270788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.299824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.300013] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7 is going to be deleted. [ 1059.301696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.301696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.303976] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.304077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.304156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.304323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.304464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.324643] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 in Status: IN_PROGRESS for 2s [ 1059.332532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.332757] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb is going to be deleted. [ 1059.398094] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.398434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.398434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.398564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.398615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.398737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bae4c6cb-055d-4c09-b1c2-e8c2df8a26a7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.408033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.408033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.408033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.408313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.408969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.409381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db08d331-3ab0-4e0c-a3f2-adfcc8ba74bb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.625252] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 542ab4ea-1934-47eb-b35d-a11a9e723c30: rpc.has_security_group_logging(os_id): False [ 1059.644593] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.644593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.644593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.644853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.667177] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.670047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.670320] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.670444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.670751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.670751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.670861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.670978] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.671723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.671798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.672015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.672134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.672384] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.672449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.672490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.672621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.672894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.673044] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1059.720023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.722512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.722512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.722512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.722512] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.722512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.722937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.722937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.722937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.722937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.723092] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.733259] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.733498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.733647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.733838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.733977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.734089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.734089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.734229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.734321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.734385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.734472] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.736244] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.736244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.736244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.736575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.736627] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.738640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.738640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.738640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.738640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.738640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.738640] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.744967] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.744967] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.744967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.745473] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.748723] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.748854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.749754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.750037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.759533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.759533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.765130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.765130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.812825] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.812825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.813879] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.813879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.817371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.817371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.817371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.817371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.817371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.817371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.817909] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.818015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.819219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.819369] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.820079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.820243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.820812] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.821272] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.821384] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.822063] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.822447] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.822546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.823132] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.823562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.823677] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afc090b2-bc85-4f97-aa84-42fe4b3085b7 is going to be deleted. [ 1059.824745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.825739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.826688] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.828551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.841341] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.841341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.885570] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.886504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.886670] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9524ba2d-0871-4060-bb89-ad3d899c17e8 is going to be deleted. [ 1059.887760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.888010] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.888212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.890103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.890103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.914214] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1059.915095] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.915272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.916824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.916953] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd59e3c-797c-4664-8f76-fa18f1a811b1 is going to be deleted. [ 1059.918043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.918200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.951883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.952194] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57fc90dd-4523-40bd-978d-d9bf1437468c is going to be deleted. [ 1059.953350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.953768] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.999972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.001055] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f119f3ea-37d4-4fbd-902f-2e9a18c9729b is going to be deleted. [ 1060.002374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.002655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.016163] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.016307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.017204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.017204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.039493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.039493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be deleted. [ 1060.040427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.040643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.096830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.096830] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcdff5a2-f30c-4336-a8cd-e116d208fd7d is going to be deleted. [ 1060.096830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.096830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.096830] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.096830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.099352] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.099531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.146478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.146478] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f is going to be deleted. [ 1060.147697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.147918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.176022] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.176194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.176274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.176466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.176560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.176658] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a is going to be created. [ 1060.228615] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.237774] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.237962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.242854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.242983] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6661d9a-0a2f-4ad7-a804-9e5004aa95db is going to be deleted. [ 1060.243849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.244074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.254100] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.260423] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.260628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.260628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.260858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.261041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.261145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.261208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.261357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.261446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.261532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.261680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.261772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.261833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.261970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.262118] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.262207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.262267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.262401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.262474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.262553] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.262641] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.264055] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.278610] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.278840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.278840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.279050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.279247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.302921] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.303144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.304245] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a in Status: UNINITIALIZED for 2s [ 1060.327830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.328057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8253b890-33c3-4c25-961c-e88cce1b8eff is going to be deleted. [ 1060.329077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.329313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.369315] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.369315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.397225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.397225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4deebf-95e4-4bfd-963f-b8c408668b1c is going to be deleted. [ 1060.397225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.397225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.399961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.401088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.449469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.449469] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c367c1a-4f7d-4875-9d05-179a78da6584 is going to be deleted. [ 1060.450697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.450697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.465050] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.465198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.489808] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.489960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.533331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.533331] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be deleted. [ 1060.534849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.534849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.619080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.619221] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24634bde-1ed8-4d4f-9db6-b19816b628d7 is going to be deleted. [ 1060.620236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.620562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.620711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.620886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afc090b2-bc85-4f97-aa84-42fe4b3085b7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.621109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.621292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.621374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.621503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9524ba2d-0871-4060-bb89-ad3d899c17e8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.622095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.622275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.622361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.622483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd59e3c-797c-4664-8f76-fa18f1a811b1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.622640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.622819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.622903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.623035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57fc90dd-4523-40bd-978d-d9bf1437468c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.623226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.623385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.623465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.623577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f119f3ea-37d4-4fbd-902f-2e9a18c9729b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.623703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.623841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.623916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.624302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.624419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcdff5a2-f30c-4336-a8cd-e116d208fd7d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.624810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.624810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e7ce968-7bf7-4fc1-8325-b5e6edecbe7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6661d9a-0a2f-4ad7-a804-9e5004aa95db" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8253b890-33c3-4c25-961c-e88cce1b8eff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.626048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.627073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.627073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.627073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4deebf-95e4-4bfd-963f-b8c408668b1c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.694470] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.694690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.694743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.694961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.695087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.695223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.697462] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.697611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.697688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.697984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.698050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.698193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c367c1a-4f7d-4875-9d05-179a78da6584" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.730803] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0866c18-786e-4157-b82e-c968cd3e4da4: rpc.has_security_group_logging(os_id): False [ 1060.757026] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e983155-2c0f-440c-885b-2648c7ee2a33: rpc.has_security_group_logging(os_id): False [ 1060.765971] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98741f74-4767-46bd-99a2-76cd0a555e4d: rpc.has_security_group_logging(os_id): False [ 1060.768177] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a02c478-9c75-420c-a387-bc52bfa702cb: rpc.has_security_group_logging(os_id): False [ 1060.789174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.789411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.789411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.789574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.811241] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.811241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.935365] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.935612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.936359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.936447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.942359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.942596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.949970] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.950577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.951067] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.951179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.951247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.951487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.951569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.951671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 is going to be updated. [ 1060.954245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.954499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.987560] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1060.987796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.015336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.015680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.015810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.015885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.016166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.016274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.016488] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1061.017716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.017926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.051408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.051668] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.051778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.051846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.052067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.052151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.052253] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1061.053741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.053968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.054075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.054592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24634bde-1ed8-4d4f-9db6-b19816b628d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.054592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.054592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.093245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.093432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.106065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.106065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.106287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.106287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.106413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.106452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.106683] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.107534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.107534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.107534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.107534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.107727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.107727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.107727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.107871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.107926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.108088] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1061.109382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.109555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.109762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.133970] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: IN_PROGRESS for 2s [ 1061.154141] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.154387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.154496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.154785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.154985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.176083] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.176083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.176083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.176083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.176532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.194069] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1061.203958] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1061.328284] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.328479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.328536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.328724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.328935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.340695] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 in Status: SUCCESS [ 1061.340899] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 deletion is rescheduled due to dependency. [ 1061.340996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.375670] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1061.573336] env[65162]: INFO networking_nsxv3.common.synchronization [req-55061042-2447-466c-869c-658108b609c1 req-a6a436b5-03dc-4cde-9e1c-25b240ee52e1 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1061.574155] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1061.574429] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.574563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.574633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.574926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.575062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.575138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.575193] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.575541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.575635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.575733] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.930329] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1061.930561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.021611] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.021993] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.022257] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.022688] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.023164] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.023444] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.023681] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.024072] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.024374] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.024747] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.024943] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.025176] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.025380] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.025592] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.025804] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.026072] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.048832] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.049043] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.049187] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.049426] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.049710] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-092cfaa4-223d-4158-a25b-e19792a4c97a taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.050027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.050172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.050539] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.050678] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('092cfaa4-223d-4158-a25b-e19792a4c97a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.078893] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.079178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.079308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.079626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.108726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.108998] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.109137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.109200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.109406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.109500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.109577] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1062.141806] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.141806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.142038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.142146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.142341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.154044] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1062.315599] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a in Status: SUCCESS [ 1062.315784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.316012] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.316284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.316510] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.316673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.316829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.317052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.317168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.317289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.317437] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.553086] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.553782] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.553782] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.553782] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.553997] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.553997] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 092cfaa4-223d-4158-a25b-e19792a4c97a not found, creating... [ 1062.554254] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.554404] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.554520] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.555148] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.555148] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.555341] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.556028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.556028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.556028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.556203] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.556203] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 092cfaa4-223d-4158-a25b-e19792a4c97a is going to be created. [ 1062.579016] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.579364] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.579501] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.579785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.580634] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.580928] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.820326] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.147031] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: SUCCESS [ 1063.147469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.212363] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1063.212614] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.217702] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1063.217876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.322301] env[65162]: INFO networking_nsxv3.common.synchronization [req-55061042-2447-466c-869c-658108b609c1 req-aacd4fe8-1fa9-4870-9fd5-ba710158831d service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 1063.322391] env[65162]: INFO networking_nsxv3.common.synchronization [req-55061042-2447-466c-869c-658108b609c1 req-aacd4fe8-1fa9-4870-9fd5-ba710158831d service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1063.322467] env[65162]: INFO networking_nsxv3.common.synchronization [req-55061042-2447-466c-869c-658108b609c1 req-aacd4fe8-1fa9-4870-9fd5-ba710158831d service nova] Enqueued Resource ID: 092cfaa4-223d-4158-a25b-e19792a4c97a with Priority: HIGHEST for action port [ 1063.323545] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 1063.323792] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1063.323978] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 092cfaa4-223d-4158-a25b-e19792a4c97a with Priority: HIGHEST for action port [ 1063.324349] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.324474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.324543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.324805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.324805] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.325998] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.325998] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.325998] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a: rpc.has_security_group_logging(os_id): False [ 1063.327127] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-092cfaa4-223d-4158-a25b-e19792a4c97a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.327273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.327330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.327473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.327552] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('092cfaa4-223d-4158-a25b-e19792a4c97a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.345475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.345685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.345764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.345969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.346080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.346322] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.346420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.346481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.346628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.346706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.346847] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a is going to be created. [ 1063.399082] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1063.399412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.429026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.429026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.429298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.429298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.429490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.440748] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a in Status: IN_PROGRESS for 2s [ 1063.830112] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.830112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.830492] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 092cfaa4-223d-4158-a25b-e19792a4c97a with status ACTIVE [ 1063.830492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.830492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.830615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.830786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.830838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.831097] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.831097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.831235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.831319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.831352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.832033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.832033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.832033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.832033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.832033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.832033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 092cfaa4-223d-4158-a25b-e19792a4c97a is going to be updated. [ 1063.863707] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.863988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.863988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.864108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.864300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.864523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-092cfaa4-223d-4158-a25b-e19792a4c97a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.165448] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1064.165448] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 1064.165448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.165448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.165621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.167040] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.167040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.167040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.167040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.167040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.167040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.671050] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.171753] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.455884] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a in Status: SUCCESS [ 1065.455884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.677819] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.678695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.678695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.681199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.681199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.681199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1065.729489] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.729489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.729489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.729489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.729489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.751963] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1066.148551] env[65162]: INFO networking_nsxv3.common.synchronization [req-3d1ece7d-19eb-4be8-9f18-9e2497d7584d req-71cfdde6-0e6d-4bd5-939c-eacc019eb9b1 tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 1066.149204] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 1066.149565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.149720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.149790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.149989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.150152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.150248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.150308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.150453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.150536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.150628] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.652978] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.155853] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.661449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.661449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.661449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.661449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.661449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.661449] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be updated. [ 1067.692577] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.692577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.692577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.692577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.692823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.702620] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 1067.766306] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1067.767406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.767406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.767406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.767406] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.768377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.768377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.768377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.768377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.768377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.768377] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.271308] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.271583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.271583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.271849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.272051] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.272209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.272209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.272390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.272464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.272540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.272669] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.272780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.272865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.272937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.273159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.273159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.273313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.273374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.273437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.273496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.273580] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.779731] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03c457f4-5193-48c8-99b4-9dd3e8a1a23d: rpc.has_security_group_logging(os_id): False [ 1068.799295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.799529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.799595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.799811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.799931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.800220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.800345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.800410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.800593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.800703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.800916] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.801044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.801143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.801312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.801408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.801630] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.801758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.801852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.802733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.802733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.802733] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1068.870249] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.870249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.871140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.871140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.871140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.892384] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1069.717738] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 1069.718103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.010136] env[65162]: INFO networking_nsxv3.common.synchronization [None req-050acf04-f74a-4a05-9185-80f41410b855 None None] Enqueued Resource ID: 2422a41a-2aa2-4dde-86ab-89b1a4d60bde with Priority: HIGHEST for action port [ 1070.010680] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2422a41a-2aa2-4dde-86ab-89b1a4d60bde with Priority: HIGHEST for action port [ 1070.010990] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2422a41a-2aa2-4dde-86ab-89b1a4d60bde taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.011133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2422a41a-2aa2-4dde-86ab-89b1a4d60bde" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.011196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2422a41a-2aa2-4dde-86ab-89b1a4d60bde" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.011452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2422a41a-2aa2-4dde-86ab-89b1a4d60bde" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.011528] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2422a41a-2aa2-4dde-86ab-89b1a4d60bde',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.178650] env[65162]: INFO networking_nsxv3.common.synchronization [req-5dcd5000-ee58-47cc-b8dc-36700073191d req-899e6017-8f71-429d-9709-a88d761b46b1 tempest-ServersV294TestFqdnHostnames-1848219887 tempest-ServersV294TestFqdnHostnames-1848219887-project-member] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_members [ 1070.179658] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_members [ 1070.180177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.180401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.180401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.180711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.180906] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.181079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.181182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.181374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.181495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.181620] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.432815] env[65162]: INFO networking_nsxv3.common.synchronization [req-2d2d40b3-73be-4ad3-a648-1708d77ca10a req-f396f242-5a43-4fc9-8820-855f52e324d3 tempest-ListServerFiltersTestJSON-1545369510 tempest-ListServerFiltersTestJSON-1545369510-project-member] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1070.432815] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1070.432815] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.432815] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.432815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.432815] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.514394] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2422a41a-2aa2-4dde-86ab-89b1a4d60bde [ 1070.514635] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.514843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.514965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.515190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.515282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.515383] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2422a41a-2aa2-4dde-86ab-89b1a4d60bde already deleted. [ 1070.515465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2422a41a-2aa2-4dde-86ab-89b1a4d60bde" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.574035] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.574035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.574035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.574035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.574035] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.574589] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.574589] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.574589] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.575800] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.575800] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.575800] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.575800] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.575800] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.575800] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.575800] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.575800] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.602869] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.603057] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.603194] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.603425] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.603756] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-34ac5474-8389-44ac-bf66-4fbd7c966406 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.603933] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.604068] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.604398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.604532] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ac5474-8389-44ac-bf66-4fbd7c966406',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.685051] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.685244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.685336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.685569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.685662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.685872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.685979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.686297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.686490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.686573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.686664] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b already deleted. [ 1070.686885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.916033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1070.916415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.941013] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.109857] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.109857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.109857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.109857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.109857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.109857] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 34ac5474-8389-44ac-bf66-4fbd7c966406 not found, creating... [ 1071.110418] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.110722] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.111046] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.111382] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.111622] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.112031] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.112321] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.112533] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.114505] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.114505] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.114505] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 34ac5474-8389-44ac-bf66-4fbd7c966406 is going to be created. [ 1071.133176] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.134720] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.134720] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.134720] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.134720] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.135039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.444837] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.499298] env[65162]: INFO networking_nsxv3.common.synchronization [req-f5e8849a-5c67-4196-a348-8a28243b3ed7 req-ea39cd44-0d0f-4d79-92ed-c9538d4d1a3d tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1071.499917] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1071.500287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.500430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.500525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.500759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.500939] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.501068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.501149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.501315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.501400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.501494] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.910358] env[65162]: INFO networking_nsxv3.common.synchronization [req-5dcd5000-ee58-47cc-b8dc-36700073191d req-9988e54f-58ec-457b-83d8-caf656d23910 service nova] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_rules [ 1071.910538] env[65162]: INFO networking_nsxv3.common.synchronization [req-5dcd5000-ee58-47cc-b8dc-36700073191d req-9988e54f-58ec-457b-83d8-caf656d23910 service nova] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_members [ 1071.910669] env[65162]: INFO networking_nsxv3.common.synchronization [req-5dcd5000-ee58-47cc-b8dc-36700073191d req-9988e54f-58ec-457b-83d8-caf656d23910 service nova] Enqueued Resource ID: 34ac5474-8389-44ac-bf66-4fbd7c966406 with Priority: HIGHEST for action port [ 1071.911180] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_rules [ 1071.911392] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_members [ 1071.911516] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac5474-8389-44ac-bf66-4fbd7c966406 with Priority: HIGHEST for action port [ 1071.911788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.911905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.911968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.912550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.912665] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.913735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.913735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.913735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.913735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.913735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.913735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.913735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.914919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.914919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.915083] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.916127] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ac5474-8389-44ac-bf66-4fbd7c966406 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.916287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.916287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.916757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.916850] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ac5474-8389-44ac-bf66-4fbd7c966406',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.949065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.949065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.949065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.949065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.949065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.949065] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1071.982799] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.982992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.983038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.983240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.983395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.992493] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1072.004522] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.004522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.004522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.004801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.004801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.005013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.005218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.005218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.005328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.005378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.005447] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1072.036488] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.040023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.040023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.040023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.040023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.046382] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1072.418696] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.419188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.419188] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.419912] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34ac5474-8389-44ac-bf66-4fbd7c966406 with status ACTIVE [ 1072.420111] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.420276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.420333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.420498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.420585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.420747] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.420840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.420914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.421099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.421167] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.421344] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.421430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.421487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.421622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.421699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.421935] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34ac5474-8389-44ac-bf66-4fbd7c966406 is going to be updated. [ 1072.446978] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.447182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.447242] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.447482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.447482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.447482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ac5474-8389-44ac-bf66-4fbd7c966406" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.453178] env[65162]: INFO networking_nsxv3.common.synchronization [None req-72cbef5d-4fab-4ff4-a6f8-6c1e7c110d18 None None] Enqueued Resource ID: f48bb8e4-ad53-4e66-809a-d5c8c964d9f3 with Priority: HIGHEST for action port [ 1072.453508] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48bb8e4-ad53-4e66-809a-d5c8c964d9f3 with Priority: HIGHEST for action port [ 1072.453862] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48bb8e4-ad53-4e66-809a-d5c8c964d9f3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.453989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48bb8e4-ad53-4e66-809a-d5c8c964d9f3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.454071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48bb8e4-ad53-4e66-809a-d5c8c964d9f3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.454945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48bb8e4-ad53-4e66-809a-d5c8c964d9f3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.454945] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48bb8e4-ad53-4e66-809a-d5c8c964d9f3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.923372] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.959346] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f48bb8e4-ad53-4e66-809a-d5c8c964d9f3 [ 1072.959486] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.959556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.959595] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.959798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.959887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.959977] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f48bb8e4-ad53-4e66-809a-d5c8c964d9f3 already deleted. [ 1072.960290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48bb8e4-ad53-4e66-809a-d5c8c964d9f3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.425329] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.425680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.425680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.425918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.426867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.426867] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b is going to be created. [ 1073.452660] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.452810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.452882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.453110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.453271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.463899] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845a1349-3919-404b-9935-ad355e3ebd5b in Status: UNINITIALIZED for 2s [ 1074.007869] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1074.008188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.058615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1074.058888] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 1074.059075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.878809] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.878809] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.878809] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.879420] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.879420] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.879514] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.879604] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.879782] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.879923] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.880148] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.880258] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.880363] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.880461] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.880563] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.880662] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.880788] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.899048] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.899277] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.899433] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.899662] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.900011] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.900210] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.900349] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.900635] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.900775] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.290805] env[65162]: INFO networking_nsxv3.common.synchronization [req-4cf255de-e205-4e31-afab-499d0d6b816f req-761bd11d-85b5-4839-a387-b21848f66737 tempest-ListServersNegativeTestJSON-360776762 tempest-ListServersNegativeTestJSON-360776762-project-member] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1075.291468] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1075.291786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.291910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.291980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.292347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.292347] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.292495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.292495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.292630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.292713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.292809] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.404297] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.404553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.404679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.405400] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.405564] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.405883] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.406062] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.406222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.406539] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.406680] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.407016] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.407188] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.407377] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.407598] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.407732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.407873] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 is going to be updated. [ 1075.430179] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.430414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.430557] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.430799] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.430996] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.431242] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.473839] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845a1349-3919-404b-9935-ad355e3ebd5b in Status: SUCCESS [ 1075.474087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.474259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.474434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.474628] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.474740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.474879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.474976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.475076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.475165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.475340] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.525115] env[65162]: INFO networking_nsxv3.common.synchronization [req-75be36a4-8f5e-415a-9943-153797b66852 req-60a3269f-e99d-4f81-9174-cd8d90a6445b tempest-ListServersNegativeTestJSON-360776762 tempest-ListServersNegativeTestJSON-360776762-project-member] Enqueued Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1075.525609] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884160b0-aa09-4db4-aad6-b412d510fa72 with Priority: HIGHEST for action security_group_members [ 1075.525916] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-884160b0-aa09-4db4-aad6-b412d510fa72 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.526044] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.795701] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.977394] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.169205] env[65162]: INFO networking_nsxv3.common.synchronization [req-fab6a6f3-3ae9-4aae-91b5-1519a7a478d3 req-d09f4d33-351d-4303-b25a-3b71363a0619 service nova] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 1076.169205] env[65162]: INFO networking_nsxv3.common.synchronization [req-fab6a6f3-3ae9-4aae-91b5-1519a7a478d3 req-d09f4d33-351d-4303-b25a-3b71363a0619 service nova] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 1076.169205] env[65162]: INFO networking_nsxv3.common.synchronization [req-fab6a6f3-3ae9-4aae-91b5-1519a7a478d3 req-d09f4d33-351d-4303-b25a-3b71363a0619 service nova] Enqueued Resource ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 with Priority: HIGHEST for action port [ 1076.169205] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_rules [ 1076.169440] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 1076.169440] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 with Priority: HIGHEST for action port [ 1076.169582] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.169698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.169819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.169962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.170079] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.170982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.171084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.171140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.171334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.171475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.171565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.171621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.171758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.171899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.171952] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.172646] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.172759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.172821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.172945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.173020] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.299094] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.480043] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 845a1349-3919-404b-9935-ad355e3ebd5b: rpc.has_security_group_logging(os_id): False [ 1076.499072] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.499261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.499318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.499535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.499622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.499881] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.499986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.500070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.500234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.500311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.500398] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b is going to be created. [ 1076.561531] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.561770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.561770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.562037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.562247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.577203] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 845a1349-3919-404b-9935-ad355e3ebd5b in Status: IN_PROGRESS for 2s [ 1076.675078] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.676047] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.676178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.676851] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 with status ACTIVE [ 1076.676851] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.676851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.676851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.677219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.677219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.677362] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.677475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.677552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.677733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.678463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.678463] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.678463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.678463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.678463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.678770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.678770] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6 is going to be updated. [ 1076.720584] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.720767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.720821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.721062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.721316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.722036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35a9e0ab-48a2-43b8-8f90-15f2baa5a0c6" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.801606] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.801786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.801861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.802191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.802290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.802395] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1076.831739] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.831913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.831970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.832244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.832390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.861485] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1077.180952] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.683790] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.684053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.684053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.684338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.684458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.684544] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a is going to be updated. [ 1077.716139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.716434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.716434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.716574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.716681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.726708] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: IN_PROGRESS for 2s [ 1078.591226] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 845a1349-3919-404b-9935-ad355e3ebd5b in Status: SUCCESS [ 1078.591741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.873175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1078.873399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.873565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.873788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.873977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.874115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.874209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.874331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.874414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.874511] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884160b0-aa09-4db4-aad6-b412d510fa72',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.378057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.378057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.378057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.378057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.378057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.378057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.378057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.378477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.378477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.378477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.378594] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 is going to be updated. [ 1079.408599] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.408776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.408823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.409034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.409190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.419132] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: IN_PROGRESS for 2s [ 1079.737645] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: SUCCESS [ 1079.738074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.738197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.738511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.738766] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.738981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.739105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.739345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.739471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.739618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.739773] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.243435] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.746368] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a29ad06f-d3bc-443d-9727-1f7cc59ff50a: rpc.has_security_group_logging(os_id): False [ 1080.786667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.786929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.786929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.787148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.813533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.813856] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.813954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.814042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.814398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.814487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.814586] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a is going to be updated. [ 1080.906298] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.906457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.906559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.906731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.906875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.921445] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: IN_PROGRESS for 2s [ 1081.170498] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1081.170610] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1081.429395] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884160b0-aa09-4db4-aad6-b412d510fa72 in Status: SUCCESS [ 1081.429634] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884160b0-aa09-4db4-aad6-b412d510fa72 deletion is rescheduled due to dependency. [ 1081.429769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884160b0-aa09-4db4-aad6-b412d510fa72" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.940799] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: SUCCESS [ 1082.941451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.320403] env[65162]: INFO networking_nsxv3.common.synchronization [None req-e265bafe-4738-438e-b084-75c1938db018 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1083.320924] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1083.321253] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.321377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.321460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.321719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.321800] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.401949] env[65162]: INFO networking_nsxv3.common.synchronization [None req-584988a8-9212-467b-a3e0-2cbbd57930bd tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1083.402473] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1083.402688] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.402939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.844792] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.844996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.845162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.845426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.845534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.845647] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 already deleted. [ 1083.845769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.845904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.846101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.846194] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.368881] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.369263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.369263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.369338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.369417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.369513] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 already deleted. [ 1084.369599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.057170] env[65162]: INFO networking_nsxv3.common.synchronization [req-b38f0145-b24b-413d-8c55-d913e80b396e req-d914a37b-a579-47b4-8028-37f636b03cac tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1085.059041] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1085.059041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.059041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.059041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.059041] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.434282] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.434686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.434686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.434864] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.435360] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.435578] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.435709] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.436033] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.436116] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.436333] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.436504] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.436578] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.436663] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.436770] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.436881] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.437018] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.460961] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.460961] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.460961] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.460961] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.460961] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-47d8bbb1-6855-4b87-b631-3efd9e484140 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.460961] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.461486] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.461486] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.461564] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47d8bbb1-6855-4b87-b631-3efd9e484140',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.560922] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.964540] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.964801] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.964909] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.965379] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.965542] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.965729] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 47d8bbb1-6855-4b87-b631-3efd9e484140 not found, creating... [ 1085.965982] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.966164] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.966285] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.966524] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.966712] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.966962] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.967165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.967294] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.967517] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.967653] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.967799] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 47d8bbb1-6855-4b87-b631-3efd9e484140 is going to be created. [ 1085.991333] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.991570] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.991676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.991930] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.992182] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.992416] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.063719] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.566641] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.566964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.566964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.567173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.567280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.567374] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1086.599489] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.599866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.599866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.599972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.600136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.618712] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1086.742921] env[65162]: INFO networking_nsxv3.common.synchronization [req-b38f0145-b24b-413d-8c55-d913e80b396e req-07d3ff19-267a-4d86-9f8f-92237e756d58 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 1086.742921] env[65162]: INFO networking_nsxv3.common.synchronization [req-b38f0145-b24b-413d-8c55-d913e80b396e req-07d3ff19-267a-4d86-9f8f-92237e756d58 service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1086.742921] env[65162]: INFO networking_nsxv3.common.synchronization [req-b38f0145-b24b-413d-8c55-d913e80b396e req-07d3ff19-267a-4d86-9f8f-92237e756d58 service nova] Enqueued Resource ID: 47d8bbb1-6855-4b87-b631-3efd9e484140 with Priority: HIGHEST for action port [ 1086.743467] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 1086.743599] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1086.743692] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d8bbb1-6855-4b87-b631-3efd9e484140 with Priority: HIGHEST for action port [ 1086.743962] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.744170] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.744235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.744427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.744571] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.745807] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.745913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.746130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-47d8bbb1-6855-4b87-b631-3efd9e484140 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.746281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.746338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.746492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.746547] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47d8bbb1-6855-4b87-b631-3efd9e484140',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.248449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.248687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.248792] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47d8bbb1-6855-4b87-b631-3efd9e484140 with status ACTIVE [ 1087.248967] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.249097] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.249166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.249410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.249478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.249666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.249772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.249835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.249990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.250084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.250328] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.250438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.250502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.250646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.250725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.250815] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47d8bbb1-6855-4b87-b631-3efd9e484140 is going to be updated. [ 1087.284129] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.284129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.284129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.284396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.284512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.284675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47d8bbb1-6855-4b87-b631-3efd9e484140" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.633638] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.633638] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.633638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.633638] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.136307] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.640081] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.143245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.143482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.143482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.143693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.143781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.143879] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1090.181082] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.181282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.181334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.181508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.181660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.191107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1090.696697] env[65162]: INFO networking_nsxv3.common.synchronization [req-4814eec6-6126-4190-b504-b88c9f9f42a1 req-172b51a8-f626-4c95-8245-ffcdcb0bbf2e tempest-ServerRescueNegativeTestJSON-1256800828 tempest-ServerRescueNegativeTestJSON-1256800828-project-member] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 1090.696697] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGHEST for action security_group_members [ 1090.696697] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.696991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.696991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.697244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.697444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.697625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.697728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.697919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.698144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.698314] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.201998] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.202238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.202238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.202434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.224950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.226110] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.226110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.226110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.226110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.226110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.226110] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be updated. [ 1091.254428] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.254608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.254656] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.254863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.255013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.264366] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: IN_PROGRESS for 2s [ 1092.205997] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1092.205997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.206383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.206581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.206799] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.206960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.207013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.207203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.207360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.207561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.207706] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.257893] env[65162]: INFO networking_nsxv3.common.synchronization [req-64648115-cabc-4c39-9f27-6a827a9099dc req-9dafd175-159b-4dbf-8cb5-45892105afb7 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1092.258959] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1092.259358] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.259483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.259555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.260079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.260079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.260079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.260079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.260243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.260303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.260415] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.710814] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.711125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.711125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.711794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.711794] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.711794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.711907] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.712069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.712163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.712271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.712446] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.712562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.712628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.712788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.712944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.713062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.713132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.713287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.713370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.713472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.713563] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.763120] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.763391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.763391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.763545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.763638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.763828] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.763929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.763992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.764165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.764244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.764356] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1092.797350] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.797533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.797602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.797855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.798022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.809999] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1093.215736] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 1093.241724] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.242836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.242836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.242961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.269163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.269605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.269605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.269605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.269962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.269962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.270127] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.270234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.270270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.270435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.270484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.272238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.272238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.272238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.272238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.272238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.272238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1093.305016] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 in Status: SUCCESS [ 1093.305016] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 deletion is rescheduled due to dependency. [ 1093.305016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.384857] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.384996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.385109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.385339] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.385477] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.401108] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1093.591345] env[65162]: INFO networking_nsxv3.common.synchronization [req-aec7a3f9-dfa1-43d4-b27a-61044320b153 req-5d4c408a-2eed-47f9-a358-a5714ebd2adf tempest-ListServerFiltersTestJSON-1545369510 tempest-ListServerFiltersTestJSON-1545369510-project-member] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1093.591648] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGHEST for action security_group_members [ 1093.592795] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.597228] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.597228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.597228] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.972037] env[65162]: INFO networking_nsxv3.common.synchronization [req-cea06e63-d499-47ed-ba38-9b6230c48b33 req-e6858614-2b47-448d-ac22-22303c1c9e02 tempest-ServerRescueTestJSON-2134412146 tempest-ServerRescueTestJSON-2134412146-project-member] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1093.972533] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1093.973927] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.973927] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.973927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.973927] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.098860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.099071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.099143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.099406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.099508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.099655] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.099763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.099830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.099975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.100065] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.100152] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be updated. [ 1094.130380] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.130667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.131125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.131125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.131210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.141380] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: IN_PROGRESS for 2s [ 1094.286716] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.287102] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.287102] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.287445] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.287744] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.287908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.288033] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.288283] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.288433] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.288640] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.288750] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.288852] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.288956] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.289075] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.289182] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.289310] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.315627] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.315921] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.316129] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.316379] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.316831] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-960bd262-6b6a-44b6-8e73-21e420155a71 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.317169] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.317383] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.317846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.318106] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960bd262-6b6a-44b6-8e73-21e420155a71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.479973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.479973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.479973] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f already deleted. [ 1094.479973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.820413] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1094.820584] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb deletion is rescheduled due to dependency. [ 1094.820651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.821255] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.822055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.822055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.822055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.822339] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.822475] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 960bd262-6b6a-44b6-8e73-21e420155a71 not found, creating... [ 1094.822888] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.823148] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.823353] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.823695] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.823921] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.824377] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.824627] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.824817] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.825191] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.825377] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.825597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 960bd262-6b6a-44b6-8e73-21e420155a71 is going to be created. [ 1094.848858] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.849216] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.849426] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.849843] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.850242] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.850508] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.419877] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1095.420153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.554849] env[65162]: INFO networking_nsxv3.common.synchronization [req-cea06e63-d499-47ed-ba38-9b6230c48b33 req-f08ee72e-2822-4be0-858e-2f586912d84a service nova] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_rules [ 1095.555223] env[65162]: INFO networking_nsxv3.common.synchronization [req-cea06e63-d499-47ed-ba38-9b6230c48b33 req-f08ee72e-2822-4be0-858e-2f586912d84a service nova] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1095.555451] env[65162]: INFO networking_nsxv3.common.synchronization [req-cea06e63-d499-47ed-ba38-9b6230c48b33 req-f08ee72e-2822-4be0-858e-2f586912d84a service nova] Enqueued Resource ID: 960bd262-6b6a-44b6-8e73-21e420155a71 with Priority: HIGHEST for action port [ 1095.556164] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_rules [ 1095.556403] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1095.556752] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960bd262-6b6a-44b6-8e73-21e420155a71 with Priority: HIGHEST for action port [ 1095.556997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.557207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.557335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.557765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.557855] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.560389] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.560455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.560510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.560707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.561083] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.561083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.561083] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.561354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.561354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.561423] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.562728] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-960bd262-6b6a-44b6-8e73-21e420155a71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.562880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.562920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.563084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.563164] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960bd262-6b6a-44b6-8e73-21e420155a71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.065705] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.066035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.067349] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.067961] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 960bd262-6b6a-44b6-8e73-21e420155a71 with status ACTIVE [ 1096.068174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.068342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.068412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.068725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.068725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.068910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.068992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.069082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.069892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.069892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.069892] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.069892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.069892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.069892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.069892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.069892] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 960bd262-6b6a-44b6-8e73-21e420155a71 is going to be updated. [ 1096.102698] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.102874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.102934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.103130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.103267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.103432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-960bd262-6b6a-44b6-8e73-21e420155a71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.153280] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98741f74-4767-46bd-99a2-76cd0a555e4d in Status: SUCCESS [ 1096.153564] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d deletion is rescheduled due to dependency. [ 1096.153836] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.571424] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.074049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.074226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.074325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.074556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.074665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.074770] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be created. [ 1097.100448] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.100702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.100702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.100967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.101337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.111631] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: UNINITIALIZED for 2s [ 1098.210871] env[65162]: INFO networking_nsxv3.common.synchronization [req-6fa865e8-db3b-487b-a57a-b88ababffb5e req-fc00edfc-6124-4363-861f-c65f459d5af8 tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1098.211917] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1098.211917] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.212016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.212057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.212260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.212427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.212539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.212687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.212757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.212900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.212966] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.565244] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.565546] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.565546] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.565839] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.566112] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.566269] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.566383] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.566589] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.566732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.566934] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.567054] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.567163] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.567292] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.567457] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.567507] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.568092] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.588083] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.588366] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.588536] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.588758] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.589121] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-cf830f2a-1188-46f2-a2a2-69dfbf71d088 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.589370] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.589503] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.589825] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.590034] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf830f2a-1188-46f2-a2a2-69dfbf71d088',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.714920] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.715057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.715138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.715367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.736695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.736967] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.737107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.737171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.737475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.737549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.737649] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1098.777717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.777919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.777919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.778153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.778351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.788872] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1099.093125] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.093374] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.093528] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.093867] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.094052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.094236] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port cf830f2a-1188-46f2-a2a2-69dfbf71d088 not found, creating... [ 1099.094612] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.094817] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.094954] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.095332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.095516] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.095932] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.096165] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.096290] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.096525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.096689] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.096861] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: cf830f2a-1188-46f2-a2a2-69dfbf71d088 is going to be created. [ 1099.118756] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.119054] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.119118] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.119449] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.119698] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.119929] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.123691] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1099.123966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.124206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.124507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.124703] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.124817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.124877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.125041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.125146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.125255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.125340] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.627076] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.627430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.627430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.627573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.627711] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.627816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.627883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.628068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.628156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.628220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.628386] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.628484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.628545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.628680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.628816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.628906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.628967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.629118] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.629194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.629274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.629366] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.825526] env[65162]: INFO networking_nsxv3.common.synchronization [req-6fa865e8-db3b-487b-a57a-b88ababffb5e req-91d594e4-abee-439a-bf5d-78fe9fb96db5 service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 1099.825968] env[65162]: INFO networking_nsxv3.common.synchronization [req-6fa865e8-db3b-487b-a57a-b88ababffb5e req-91d594e4-abee-439a-bf5d-78fe9fb96db5 service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1099.825968] env[65162]: INFO networking_nsxv3.common.synchronization [req-6fa865e8-db3b-487b-a57a-b88ababffb5e req-91d594e4-abee-439a-bf5d-78fe9fb96db5 service nova] Enqueued Resource ID: cf830f2a-1188-46f2-a2a2-69dfbf71d088 with Priority: HIGHEST for action port [ 1099.826342] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 1099.826478] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1099.826577] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf830f2a-1188-46f2-a2a2-69dfbf71d088 with Priority: HIGHEST for action port [ 1099.826841] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.826958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.827040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.827286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.827459] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.828255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.828378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.828482] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf830f2a-1188-46f2-a2a2-69dfbf71d088 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.828580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.828754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.828800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.828860] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf830f2a-1188-46f2-a2a2-69dfbf71d088',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.132078] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c05adefa-98e3-4c1c-adb3-589d73d33b2f: rpc.has_security_group_logging(os_id): False [ 1100.151778] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.151999] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.152059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.152245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.152349] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.152557] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.152657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.152792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.152969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.153070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.153271] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.153379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.153433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.153564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.153654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.153831] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.153935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.154022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.154149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.154240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.154329] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be created. [ 1100.234875] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.234960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.235034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.235352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.235589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.251284] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: IN_PROGRESS for 2s [ 1100.331116] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.331331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.331446] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf830f2a-1188-46f2-a2a2-69dfbf71d088 with status ACTIVE [ 1100.331617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.331726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.331790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.332022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.332205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.332290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.332385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.332447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.332604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.332685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.332865] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.332956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.333034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.333172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.333247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.333336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf830f2a-1188-46f2-a2a2-69dfbf71d088 is going to be updated. [ 1100.361253] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.361253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.361253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.361253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.361253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.361253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf830f2a-1188-46f2-a2a2-69dfbf71d088" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.799050] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1100.799357] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 deletion is rescheduled due to dependency. [ 1100.799357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.799508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.799711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.799889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.800014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.800115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.800281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.800373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.800474] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.808731] env[65162]: INFO networking_nsxv3.common.synchronization [req-0ea3cc90-f68a-4174-83de-64f56ae39125 req-3e721114-cee5-45cc-857a-aeeb27a9ff81 tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1100.809817] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1100.810186] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.810342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.810423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.810629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.810800] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.810933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.811014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.811310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.811310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.811376] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.303177] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.313562] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.807226] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.816929] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.263050] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1102.263287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.310181] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.310568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.310568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.310890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.310975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.311155] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1102.319777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.319927] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.320157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.320403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.320510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.320627] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1102.342690] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.343476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.343476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.343476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.343476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.345502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.346419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.346419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.346419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.346419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.357381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1102.358273] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1104.371723] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1104.372104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.372137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.372360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.372597] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.372714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.372847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.372969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.373069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.373198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.373255] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.374728] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1104.375345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.876560] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.379713] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ef750e-5b63-4b25-85ba-13ff2b01aab2: rpc.has_security_group_logging(os_id): False [ 1105.401558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.402438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.402438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.402438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.402438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.403165] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.403165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.403165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.403388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.403432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.403551] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1105.476204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.476356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.476429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.476635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.476782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.489948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1105.810574] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.810726] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1107.092362] env[65162]: INFO networking_nsxv3.common.synchronization [req-d349a007-4344-4e84-8b14-f13d16df8a6c req-bcd14420-bf0f-4bf5-9a4d-663c4c2bd20e tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1107.092882] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1107.093227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.093550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.093550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.093671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.093819] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.093909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.093976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.094207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.094389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.094389] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.453071] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.453277] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.453410] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.453690] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.453958] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.456735] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.456735] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.456735] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.456735] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.456735] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.456735] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.456735] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.456735] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.456735] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.456735] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.456735] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.479357] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.479532] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.479669] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.479844] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.480189] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-ae471c10-2272-4039-b54a-c1fa21e97c21 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.480358] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.480475] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.480802] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.480939] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae471c10-2272-4039-b54a-c1fa21e97c21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.504710] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1107.504945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.596298] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.596478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.596478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.596670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.596762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.596958] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.597103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.597186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.597375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.597458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.597546] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 already deleted. [ 1107.597628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.987035] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.987035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port ae471c10-2272-4039-b54a-c1fa21e97c21 not found, creating... [ 1107.987035] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.987035] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.987555] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.987555] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.987971] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.988404] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.988705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.988992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: ae471c10-2272-4039-b54a-c1fa21e97c21 is going to be created. [ 1108.021764] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.022073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.022256] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.022583] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.022871] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.023296] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.726022] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b59bb97c-b2af-42bb-9a42-bbce408bc279 None None] Enqueued Resource ID: 78e41ef2-ca54-41dd-b8d7-4423184aa1d3 with Priority: HIGHEST for action port [ 1108.726022] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78e41ef2-ca54-41dd-b8d7-4423184aa1d3 with Priority: HIGHEST for action port [ 1108.726383] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-78e41ef2-ca54-41dd-b8d7-4423184aa1d3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.726383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78e41ef2-ca54-41dd-b8d7-4423184aa1d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.726492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78e41ef2-ca54-41dd-b8d7-4423184aa1d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.726662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78e41ef2-ca54-41dd-b8d7-4423184aa1d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.726742] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78e41ef2-ca54-41dd-b8d7-4423184aa1d3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.860108] env[65162]: INFO networking_nsxv3.common.synchronization [req-d349a007-4344-4e84-8b14-f13d16df8a6c req-108009c7-beaf-453c-9197-3e657d803df8 service nova] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1108.860108] env[65162]: INFO networking_nsxv3.common.synchronization [req-d349a007-4344-4e84-8b14-f13d16df8a6c req-108009c7-beaf-453c-9197-3e657d803df8 service nova] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1108.860108] env[65162]: INFO networking_nsxv3.common.synchronization [req-d349a007-4344-4e84-8b14-f13d16df8a6c req-108009c7-beaf-453c-9197-3e657d803df8 service nova] Enqueued Resource ID: ae471c10-2272-4039-b54a-c1fa21e97c21 with Priority: HIGHEST for action port [ 1108.862775] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1108.863074] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1108.863278] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae471c10-2272-4039-b54a-c1fa21e97c21 with Priority: HIGHEST for action port [ 1108.864001] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.864821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.864986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.865395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.865567] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.867290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.868020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.868020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.868020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.871239] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.871239] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.871239] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae471c10-2272-4039-b54a-c1fa21e97c21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.871239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.871239] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae471c10-2272-4039-b54a-c1fa21e97c21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.230677] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78e41ef2-ca54-41dd-b8d7-4423184aa1d3 [ 1109.230677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.230677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.230677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.231095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.231095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.231095] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78e41ef2-ca54-41dd-b8d7-4423184aa1d3 already deleted. [ 1109.231095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78e41ef2-ca54-41dd-b8d7-4423184aa1d3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.378160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.378160] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.378160] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae471c10-2272-4039-b54a-c1fa21e97c21 with status ACTIVE [ 1109.378160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.378160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.378160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.378666] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.378666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.378666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.378666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.378666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.378666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae471c10-2272-4039-b54a-c1fa21e97c21 is going to be updated. [ 1109.408835] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.409026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.409085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.409313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.409465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.409673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae471c10-2272-4039-b54a-c1fa21e97c21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.885355] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.390132] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.390132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.390132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.390132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.390132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.390132] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be created. [ 1110.419663] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.419663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.419663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.419663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.419663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.433459] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: UNINITIALIZED for 2s [ 1111.249215] env[65162]: INFO networking_nsxv3.common.synchronization [None req-bbbbbc19-0918-4de4-b486-6b3b2327d113 None None] Enqueued Resource ID: eb814280-a0a4-4872-8a91-f5b43ffe9a6e with Priority: HIGHEST for action port [ 1111.250919] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb814280-a0a4-4872-8a91-f5b43ffe9a6e with Priority: HIGHEST for action port [ 1111.251893] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb814280-a0a4-4872-8a91-f5b43ffe9a6e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.253040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb814280-a0a4-4872-8a91-f5b43ffe9a6e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.253040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb814280-a0a4-4872-8a91-f5b43ffe9a6e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.253040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb814280-a0a4-4872-8a91-f5b43ffe9a6e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.253040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb814280-a0a4-4872-8a91-f5b43ffe9a6e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.755476] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb814280-a0a4-4872-8a91-f5b43ffe9a6e [ 1111.755852] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.756820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.756820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.756964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.757035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.757337] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb814280-a0a4-4872-8a91-f5b43ffe9a6e already deleted. [ 1111.757337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb814280-a0a4-4872-8a91-f5b43ffe9a6e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.927102] env[65162]: INFO networking_nsxv3.common.synchronization [None req-389aa33c-c40a-493c-89eb-a6ba7e250c7f None None] Enqueued Resource ID: 869b2096-066d-4e8e-b3dc-6104ea7ad42b with Priority: HIGHEST for action port [ 1111.927679] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869b2096-066d-4e8e-b3dc-6104ea7ad42b with Priority: HIGHEST for action port [ 1111.928242] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-869b2096-066d-4e8e-b3dc-6104ea7ad42b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.928402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-869b2096-066d-4e8e-b3dc-6104ea7ad42b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.928815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-869b2096-066d-4e8e-b3dc-6104ea7ad42b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.928815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-869b2096-066d-4e8e-b3dc-6104ea7ad42b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.928815] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('869b2096-066d-4e8e-b3dc-6104ea7ad42b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.998094] env[65162]: INFO networking_nsxv3.common.synchronization [req-3e9294fa-bad7-4a2e-a8e3-af91d0c1d214 req-729d83a5-94a0-479a-93eb-4b1e76554cdc tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_members [ 1111.999101] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGHEST for action security_group_members [ 1111.999701] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.999701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.999701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.999996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.999996] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.000252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.000252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.002831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.002831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.002831] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.436436] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 869b2096-066d-4e8e-b3dc-6104ea7ad42b [ 1112.436769] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.436831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.436864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.437485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.437485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.437485] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:869b2096-066d-4e8e-b3dc-6104ea7ad42b already deleted. [ 1112.437485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-869b2096-066d-4e8e-b3dc-6104ea7ad42b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.452558] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.452558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.452558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.452558] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.503703] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.503784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.503826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.505639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.505639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.505639] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.505639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.505639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.505639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.505639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.505639] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 is going to be updated. [ 1112.535222] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.535421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.535519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.535770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.536230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.550091] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: IN_PROGRESS for 2s [ 1112.961078] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.463659] env[65162]: INFO networking_nsxv3.common.synchronization [req-3b94a2ee-577b-493f-bf7f-3c0497d7266f req-e888ed89-5aa3-4012-a662-eb7f0f6afaa8 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1113.463988] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05f11b06-d4ac-4526-b2b0-8dcd11c88e34: rpc.has_security_group_logging(os_id): False [ 1113.469747] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1113.469747] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.469747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.469747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.469747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.471204] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.471377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.471436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.471581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.471828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.471828] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.490906] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.491055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.491125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.491321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.491412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.491791] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.491791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.491888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.492035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.492143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.492316] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be created. [ 1113.565682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.565870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.565948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.566131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.566313] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.582182] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: IN_PROGRESS for 2s [ 1113.972053] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.972053] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.972053] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.973215] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.973215] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.973364] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.973423] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.973915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.974084] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.974320] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.974429] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.974538] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.974669] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.974778] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.974937] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.975129] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.977449] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.977449] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.977588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.977711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.977795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.977957] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.978068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.978124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.978327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.978532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.978612] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1114.005783] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.005954] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1114.006106] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.006325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-435" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.006674] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.006843] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.006959] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.007383] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.007563] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.014728] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.015032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.015141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.015366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.015552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.027470] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1114.327677] env[65162]: INFO networking_nsxv3.common.synchronization [None req-73db4c1f-2632-4515-8059-b97b3f9a7972 None None] Enqueued Resource ID: d034f0fb-6df6-4ece-9fc3-7f453bac9660 with Priority: HIGHEST for action port [ 1114.328329] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d034f0fb-6df6-4ece-9fc3-7f453bac9660 with Priority: HIGHEST for action port [ 1114.328515] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-d034f0fb-6df6-4ece-9fc3-7f453bac9660 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.328809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d034f0fb-6df6-4ece-9fc3-7f453bac9660" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.328809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d034f0fb-6df6-4ece-9fc3-7f453bac9660" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.328928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d034f0fb-6df6-4ece-9fc3-7f453bac9660" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.329019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d034f0fb-6df6-4ece-9fc3-7f453bac9660',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.510782] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.511133] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.511171] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.511509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.511692] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.511876] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b not found, creating... [ 1114.512197] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.512392] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.512541] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.512785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.512951] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.513275] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.513437] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.513555] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.513770] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.513924] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.514109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b is going to be created. [ 1114.536509] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.536730] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.536855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.537143] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.537368] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.537677] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.559084] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0866c18-786e-4157-b82e-c968cd3e4da4 in Status: SUCCESS [ 1114.559278] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 deletion is rescheduled due to dependency. [ 1114.559399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.831565] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d034f0fb-6df6-4ece-9fc3-7f453bac9660 [ 1114.831812] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.831945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.832026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.832259] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.832350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.832449] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d034f0fb-6df6-4ece-9fc3-7f453bac9660 already deleted. [ 1114.832531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d034f0fb-6df6-4ece-9fc3-7f453bac9660" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.239758] env[65162]: INFO networking_nsxv3.common.synchronization [req-3b94a2ee-577b-493f-bf7f-3c0497d7266f req-7480a9f9-f335-4b94-87c7-37493c9826cc service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 1115.239880] env[65162]: INFO networking_nsxv3.common.synchronization [req-3b94a2ee-577b-493f-bf7f-3c0497d7266f req-7480a9f9-f335-4b94-87c7-37493c9826cc service nova] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1115.240223] env[65162]: INFO networking_nsxv3.common.synchronization [req-3b94a2ee-577b-493f-bf7f-3c0497d7266f req-7480a9f9-f335-4b94-87c7-37493c9826cc service nova] Enqueued Resource ID: f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b with Priority: HIGHEST for action port [ 1115.240680] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_rules [ 1115.240926] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1115.240981] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b with Priority: HIGHEST for action port [ 1115.241674] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.241809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.241899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.242266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.242266] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.244274] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.244375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.244732] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.244732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.244732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.245496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.245547] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.595154] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1115.595456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.745566] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.745867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.749386] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b with status ACTIVE [ 1115.749386] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.750746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.750746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.750746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.751130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.751130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.751130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.751210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.751300] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b is going to be updated. [ 1115.773652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.773879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.773879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.774093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.774237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.774403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d61bf5-99d3-4a2f-93f6-06a1e9992b4b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.036976] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1116.037240] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 1116.037362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.037599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.037855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.037994] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.038135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.038212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.038343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.038427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.038559] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.540765] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.043647] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.547063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.547265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.547427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.547680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.547776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.547909] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1117.578846] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.578971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.579080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.579284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.579431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.588828] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1119.601538] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1119.601971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.602061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.602256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.602511] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.602645] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.602714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.602893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.603023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.603122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.603220] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.110476] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.111198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.111380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.111661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.112436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.112567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.112638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.112827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.112827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.113037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.113178] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.113279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.113340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.113489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.113625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.113716] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.113775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.113910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.113984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.114076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.114170] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.242735] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1120.242735] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1120.616155] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 542ab4ea-1934-47eb-b35d-a11a9e723c30: rpc.has_security_group_logging(os_id): False [ 1120.635309] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.635567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.635665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.635892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.635984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.636212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.636353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.636390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.636562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.636660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.636925] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.637052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.637164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.637235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.637309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.637605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.637733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.637798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.638067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.638231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.638326] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1120.757943] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.758177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.758275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.758564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.758767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.780027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1121.179128] env[65162]: INFO networking_nsxv3.common.synchronization [req-63d44aca-e0bc-482a-8e87-392cc2c54489 req-09b23059-cbd0-4f31-9627-95e124cd80ba tempest-ServersV294TestFqdnHostnames-1848219887 tempest-ServersV294TestFqdnHostnames-1848219887-project-member] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_members [ 1121.179518] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGHEST for action security_group_members [ 1121.181983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.181983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.181983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.181983] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.686570] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.686570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.686570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.686931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.686931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.686982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.687120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.687120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.687277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.687364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.687496] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b is going to be updated. [ 1121.717750] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.717965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.718022] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.718265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.718423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.726623] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845a1349-3919-404b-9935-ad355e3ebd5b in Status: IN_PROGRESS for 2s [ 1122.798633] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1122.799063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.203116] env[65162]: INFO networking_nsxv3.common.synchronization [None req-856b8174-2b29-473c-a569-778fd5331106 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_rules [ 1123.203653] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_rules [ 1123.203944] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.204282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.204388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.204630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.204716] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.224302] env[65162]: INFO networking_nsxv3.common.synchronization [req-3aef42fd-ec4a-4783-8e64-e089145cb112 req-6d262c4c-0f56-4a15-9b95-28bb696639cc tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1123.225173] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1123.225518] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.225643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.225708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.229020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.229236] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.229589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.229589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.229589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.229745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.229787] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.307384] env[65162]: INFO networking_nsxv3.common.synchronization [None req-35f5b560-b521-4831-81f0-61ffb47ca6f5 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_rules [ 1123.308390] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_rules [ 1123.308893] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.309081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.549073] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.549398] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.549627] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.550189] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.550604] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.550859] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.551070] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.551423] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.551676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.552032] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.552222] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.552390] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.552547] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.552707] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.552856] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.553062] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.573648] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.573827] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.573967] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.574159] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.574471] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-15df6255-2fb7-410a-8a81-c489c18503e5 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.574644] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.574767] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.575098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.575237] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15df6255-2fb7-410a-8a81-c489c18503e5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.725796] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.726072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.726072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.726226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.726303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.726400] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f already deleted. [ 1123.726491] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.726631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.726786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.726875] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.732809] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.732974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.733096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.733314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.733466] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.733723] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.733845] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.733913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.734126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.734223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.734328] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1123.736063] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845a1349-3919-404b-9935-ad355e3ebd5b in Status: SUCCESS [ 1123.736240] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b deletion is rescheduled due to dependency. [ 1123.736355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.759323] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.759461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.759526] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.759724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.759882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.769957] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1124.077497] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.077908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.077950] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.078232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.078381] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.078602] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 15df6255-2fb7-410a-8a81-c489c18503e5 not found, creating... [ 1124.078901] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.079099] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.079224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.079451] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.079584] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.079857] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.080018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.080145] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.080344] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.080513] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.080715] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 15df6255-2fb7-410a-8a81-c489c18503e5 is going to be created. [ 1124.105365] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.105591] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.105705] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.105986] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.106238] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.106467] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.251045] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.251045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.251045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.251045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.251045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.251045] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f already deleted. [ 1124.251045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.892207] env[65162]: INFO networking_nsxv3.common.synchronization [req-3aef42fd-ec4a-4783-8e64-e089145cb112 req-d10bed12-7c9e-42f2-92e0-8ebafd9cb3a9 service nova] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 1124.892583] env[65162]: INFO networking_nsxv3.common.synchronization [req-3aef42fd-ec4a-4783-8e64-e089145cb112 req-d10bed12-7c9e-42f2-92e0-8ebafd9cb3a9 service nova] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1124.892583] env[65162]: INFO networking_nsxv3.common.synchronization [req-3aef42fd-ec4a-4783-8e64-e089145cb112 req-d10bed12-7c9e-42f2-92e0-8ebafd9cb3a9 service nova] Enqueued Resource ID: 15df6255-2fb7-410a-8a81-c489c18503e5 with Priority: HIGHEST for action port [ 1124.893215] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 1124.893372] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1124.893469] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15df6255-2fb7-410a-8a81-c489c18503e5 with Priority: HIGHEST for action port [ 1124.893847] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.894050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.894588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.894839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.895180] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.895860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.896951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.896951] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-15df6255-2fb7-410a-8a81-c489c18503e5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.896951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.896951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.896951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.896951] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15df6255-2fb7-410a-8a81-c489c18503e5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.399270] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.399270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.400828] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15df6255-2fb7-410a-8a81-c489c18503e5 with status ACTIVE [ 1125.400828] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.400828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.400828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.400828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.400828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.401133] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.401133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.401133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.401240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.401301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.401482] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.402015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.402114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.402778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.402778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.402778] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15df6255-2fb7-410a-8a81-c489c18503e5 is going to be updated. [ 1125.426357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.426516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.426771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.426771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.426906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.427115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15df6255-2fb7-410a-8a81-c489c18503e5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.502990] env[65162]: INFO networking_nsxv3.common.synchronization [req-70179dc2-4e0b-4010-8dae-886a58d6cddc req-46c17933-3c9e-45be-9cdb-7aeefdc4291e tempest-ServersNegativeTestMultiTenantJSON-421809744 tempest-ServersNegativeTestMultiTenantJSON-421809744-project-member] Enqueued Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_members [ 1125.503555] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_members [ 1125.503866] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.503982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.504105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.504398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.504607] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.504693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.504693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.504830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.504925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.505105] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.781056] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1125.781304] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb deletion is rescheduled due to dependency. [ 1125.781380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.781542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.781755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.782021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.782166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.782248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.782391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.782469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.782708] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.872775] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.873027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-117" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.873126] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-117" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.873475] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-117" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.873746] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.873906] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.874041] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.874553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.874553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.874638] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.874693] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.874801] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.874911] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.875030] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.875157] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.875297] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.899741] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.899920] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.900068] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.900258] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-117" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.900576] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-27a148be-acc9-456c-b544-679b494a789e taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.901295] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.901295] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.901295] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.901448] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27a148be-acc9-456c-b544-679b494a789e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.007212] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.007329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.007415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.007660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.007758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.008142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.008266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.008330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.008493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.008572] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.008662] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 already deleted. [ 1126.008746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.285301] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.406148] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.406509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.406509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.406783] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.406930] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.407095] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 27a148be-acc9-456c-b544-679b494a789e not found, creating... [ 1126.407354] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.407516] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.407677] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.407896] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.408055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.408336] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.408652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.408652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.409335] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.409500] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.409645] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 27a148be-acc9-456c-b544-679b494a789e is going to be created. [ 1126.430205] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.430414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.430543] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.430809] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.432090] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.432417] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.788232] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.178289] env[65162]: INFO networking_nsxv3.common.synchronization [req-70179dc2-4e0b-4010-8dae-886a58d6cddc req-6f9fc9c9-ea8f-4ee6-991e-6affbabadd55 service nova] Enqueued Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_rules [ 1127.178494] env[65162]: INFO networking_nsxv3.common.synchronization [req-70179dc2-4e0b-4010-8dae-886a58d6cddc req-6f9fc9c9-ea8f-4ee6-991e-6affbabadd55 service nova] Enqueued Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_members [ 1127.178700] env[65162]: INFO networking_nsxv3.common.synchronization [req-70179dc2-4e0b-4010-8dae-886a58d6cddc req-6f9fc9c9-ea8f-4ee6-991e-6affbabadd55 service nova] Enqueued Resource ID: 27a148be-acc9-456c-b544-679b494a789e with Priority: HIGHEST for action port [ 1127.179357] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_rules [ 1127.179501] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_members [ 1127.179599] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a148be-acc9-456c-b544-679b494a789e with Priority: HIGHEST for action port [ 1127.179968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.180606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.180728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.181078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.181131] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.182101] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.182347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.182347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.182469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.182667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.182752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.182806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.182992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.183121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.183430] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.184247] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-27a148be-acc9-456c-b544-679b494a789e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.184536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.184536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.184611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.184780] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27a148be-acc9-456c-b544-679b494a789e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.291246] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.291489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.291545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.291972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.292184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.292430] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1127.329222] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.329453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.329453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.329709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.329862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.338773] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1127.687045] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.688229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.688355] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.688509] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27a148be-acc9-456c-b544-679b494a789e with status ACTIVE [ 1127.688710] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.688835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.688912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.689270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.689418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.689614] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.689805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.689875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.690060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.692173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.693057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.693057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.693057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.693057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.693057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.693057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27a148be-acc9-456c-b544-679b494a789e is going to be updated. [ 1127.719554] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.719554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.719554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.719811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.720051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.720283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27a148be-acc9-456c-b544-679b494a789e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.935207] env[65162]: INFO networking_nsxv3.common.synchronization [req-3009095b-528f-427f-a66a-d62d227cc1ba req-eb426aec-5bb7-4aa2-ac95-97ea4e70597e tempest-ServerRescueTestJSON-2134412146 tempest-ServerRescueTestJSON-2134412146-project-member] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1127.935746] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1127.936334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.936334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.936334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.936760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.936760] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.936893] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.936939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.937119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.937207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.937304] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.196240] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.237964] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.238327] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.238528] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.238945] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.239385] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.239638] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.239860] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.240222] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.240386] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.240598] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.240722] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.240833] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.240941] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.241061] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.241168] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.241315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.265837] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.265837] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1128.265837] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.266073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-424" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.266200] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-fec2f680-d5df-41b3-9ea1-45416bce41d2 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.266371] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.266483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.266859] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.267015] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fec2f680-d5df-41b3-9ea1-45416bce41d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.439328] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.699367] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.700445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.700445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.701377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.701377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.702831] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 is going to be created. [ 1128.731557] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.731757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.731757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.731965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.732134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.743210] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 in Status: UNINITIALIZED for 2s [ 1128.769593] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.769836] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.769960] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.770268] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.770418] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.770568] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port fec2f680-d5df-41b3-9ea1-45416bce41d2 not found, creating... [ 1128.770829] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.770988] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.771117] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.771333] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.771466] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.771742] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.771909] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.772018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.772427] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.772566] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.772709] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: fec2f680-d5df-41b3-9ea1-45416bce41d2 is going to be created. [ 1128.798057] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.798057] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.798057] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.798057] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.798057] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.798409] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.941618] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.349102] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1129.349389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.349633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.349909] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.350211] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.350433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.350495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.350681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.350806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.350918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.352651] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.443782] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.443964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.444066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.444321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.444433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.444670] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be updated. [ 1129.475219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.475432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.475481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.475694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.475852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.485719] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: IN_PROGRESS for 2s [ 1129.522541] env[65162]: INFO networking_nsxv3.common.synchronization [req-3009095b-528f-427f-a66a-d62d227cc1ba req-92f215d5-6ac1-49c8-b41d-e71b785829ef service nova] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_rules [ 1129.522781] env[65162]: INFO networking_nsxv3.common.synchronization [req-3009095b-528f-427f-a66a-d62d227cc1ba req-92f215d5-6ac1-49c8-b41d-e71b785829ef service nova] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1129.522928] env[65162]: INFO networking_nsxv3.common.synchronization [req-3009095b-528f-427f-a66a-d62d227cc1ba req-92f215d5-6ac1-49c8-b41d-e71b785829ef service nova] Enqueued Resource ID: fec2f680-d5df-41b3-9ea1-45416bce41d2 with Priority: HIGHEST for action port [ 1129.523536] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_rules [ 1129.523764] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1129.523764] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec2f680-d5df-41b3-9ea1-45416bce41d2 with Priority: HIGHEST for action port [ 1129.524756] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.524756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.524756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.524756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.524756] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.525677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.525860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.526015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fec2f680-d5df-41b3-9ea1-45416bce41d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.526257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.526257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.526387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.526432] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fec2f680-d5df-41b3-9ea1-45416bce41d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.854213] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.029326] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.029326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.029326] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fec2f680-d5df-41b3-9ea1-45416bce41d2 with status ACTIVE [ 1130.029326] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.029326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.029326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.029326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.029326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.029646] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.029646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.029646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.029847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.029879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.030075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.030188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.030240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.030356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.030433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.030515] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fec2f680-d5df-41b3-9ea1-45416bce41d2 is going to be updated. [ 1130.051652] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.051856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.051933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.052163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.052299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.052465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fec2f680-d5df-41b3-9ea1-45416bce41d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.346202] env[65162]: INFO networking_nsxv3.common.synchronization [req-eafe6ca1-df39-4b9c-a585-6dcae2aa5ffb req-d69c5a74-109d-4068-8328-0a017998d721 tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1130.350419] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1130.350419] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.350419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.350419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.350419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.350419] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.350844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.350844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.350844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.350844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.350844] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.356898] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a02c478-9c75-420c-a387-bc52bfa702cb: rpc.has_security_group_logging(os_id): False [ 1130.378210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.378210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.378210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.378210] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1130.534865] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.535036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.535078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.535280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.535425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.553306] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1130.696330] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.696563] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.696663] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.697069] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.697374] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.697527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.697679] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.697965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.698058] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.698275] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.698373] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.698475] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.698593] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.698704] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.698805] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.698929] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.720152] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.720298] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.720431] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.720607] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-958" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.720933] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-0e047b5b-4001-4300-b001-52624ec00307 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.721110] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.721248] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.721541] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.721668] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e047b5b-4001-4300-b001-52624ec00307',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.755846] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 in Status: SUCCESS [ 1130.756102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.756268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.756489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.756693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.756812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.756878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.757056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.757137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.757220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.757309] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.853308] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.224579] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.225074] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.225261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.225615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.225949] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.226260] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 0e047b5b-4001-4300-b001-52624ec00307 not found, creating... [ 1131.226746] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.227015] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.227194] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.227800] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.228142] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.228638] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.228954] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.229143] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.229456] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.229724] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.229833] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 0e047b5b-4001-4300-b001-52624ec00307 is going to be created. [ 1131.258681] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.258892] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.259044] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.259337] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.259614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.259817] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.260889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.261046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.261128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.261279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.261439] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.261537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.261598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.261739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.261823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.261905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.262063] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.262153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.262214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.262352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.262483] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.262569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.262628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.262761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.262834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.262914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.263014] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.355730] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.496563] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1131.496790] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.496958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.497199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.497385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.497501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.497565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.497801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.497884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.497982] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.770249] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90d61f12-2370-49b2-b09d-04dcee0f59d7: rpc.has_security_group_logging(os_id): False [ 1131.791700] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.791856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.792192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.792265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.792368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.792543] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.792737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.792737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.792838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.792913] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.793129] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.793224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.793285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.793425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.793497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.793676] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.793769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.793858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.793986] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.794028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.794117] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 is going to be created. [ 1131.859630] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.859630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.859630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.859630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.859630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.859630] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1131.875473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.875699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.875764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.875979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.876621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.889157] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 in Status: IN_PROGRESS for 2s [ 1131.902854] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.903112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.903183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.903421] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.903621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.913497] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1131.990750] env[65162]: INFO networking_nsxv3.common.synchronization [req-eafe6ca1-df39-4b9c-a585-6dcae2aa5ffb req-bbe46128-2b05-406b-9847-a8fa9082daec service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 1131.990964] env[65162]: INFO networking_nsxv3.common.synchronization [req-eafe6ca1-df39-4b9c-a585-6dcae2aa5ffb req-bbe46128-2b05-406b-9847-a8fa9082daec service nova] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1131.991157] env[65162]: INFO networking_nsxv3.common.synchronization [req-eafe6ca1-df39-4b9c-a585-6dcae2aa5ffb req-bbe46128-2b05-406b-9847-a8fa9082daec service nova] Enqueued Resource ID: 0e047b5b-4001-4300-b001-52624ec00307 with Priority: HIGHEST for action port [ 1131.991722] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_rules [ 1131.991863] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1131.993767] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e047b5b-4001-4300-b001-52624ec00307 with Priority: HIGHEST for action port [ 1131.994139] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.994282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.994354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.994567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.994651] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.996293] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.996401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.996610] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e047b5b-4001-4300-b001-52624ec00307 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.996733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.996802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.996991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.997075] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e047b5b-4001-4300-b001-52624ec00307',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.000462] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.499534] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.499886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.499886] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e047b5b-4001-4300-b001-52624ec00307 with status ACTIVE [ 1132.500238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.500412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.500480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.501348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.501348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.501348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.501348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.501348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.501348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.501348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.501630] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.502520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.502520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.502520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.502520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.502520] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e047b5b-4001-4300-b001-52624ec00307 is going to be updated. [ 1132.503622] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.530436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.530612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.530667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.531088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.531088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.531185] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e047b5b-4001-4300-b001-52624ec00307" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.568518] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1132.568518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.007102] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.007281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.007382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.007574] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.007702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.007808] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be updated. [ 1133.040096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.040262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.040336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.040550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.040700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.049587] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: IN_PROGRESS for 2s [ 1133.904015] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 in Status: SUCCESS [ 1133.904376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.925070] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1133.925070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.925070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.925070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.925360] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.925426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.925426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.925743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.925835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.925997] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.428815] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.931740] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.058431] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1135.058654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.058876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.059106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.059319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.059490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.059490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.059644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.059726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.059867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.059908] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.218588] env[65162]: INFO networking_nsxv3.common.synchronization [req-90f014f0-133e-4d63-9da0-61f8d42c65cb req-3f8c787f-d184-412e-8bdc-626453c660ff tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1135.218848] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1135.220043] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.220043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.220043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.220043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.220043] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.220043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.220043] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.220419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.220419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.220419] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.434113] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.434298] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.434417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.434657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.434741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.434959] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1135.464832] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.464987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.465073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.465285] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.465429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.476583] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1135.514178] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.514374] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.514519] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.514846] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.515131] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.515288] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.515400] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.515614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.515756] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.515966] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.516133] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.516262] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.516373] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.516483] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.516587] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.516722] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.534332] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.534839] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.534839] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.534839] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.535135] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-224c840b-a4b3-466d-91d9-b61374609e3c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.535306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.535423] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.535803] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.535988] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('224c840b-a4b3-466d-91d9-b61374609e3c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.562147] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.562363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.562363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.562581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.562743] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.562847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.562908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.563229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.563329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.563420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.563565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.563714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.563776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.563917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.564065] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.564156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.564215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.564351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.564426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.564503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.564588] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.726521] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.038999] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.039523] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.039523] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.039757] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.039968] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.040162] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 224c840b-a4b3-466d-91d9-b61374609e3c not found, creating... [ 1136.040446] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.040622] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.041019] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.041019] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.041159] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.041423] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.041574] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.041715] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.041908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.042073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.042236] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 224c840b-a4b3-466d-91d9-b61374609e3c is going to be created. [ 1136.068322] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.068322] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.068537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.069305] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.069638] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.069926] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.071050] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c05adefa-98e3-4c1c-adb3-589d73d33b2f: rpc.has_security_group_logging(os_id): False [ 1136.109023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.109023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.109023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.109023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.110021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.110898] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.111160] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.111317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.111563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.111729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.111900] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be updated. [ 1136.225918] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.226133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.226191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.226450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.226616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.228455] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.260366] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: IN_PROGRESS for 2s [ 1136.271252] env[65162]: INFO networking_nsxv3.common.synchronization [req-57927eb0-82a2-4e40-b618-26b60a15e5c8 req-b17a0c89-151e-4b1a-90f2-d9b8a9f6d5bb tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1136.274531] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1136.277980] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.278216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.278325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.279142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.279466] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.280686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.280686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.280686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.280686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.280686] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.730533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.730743] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.730850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.731228] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.731367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.731500] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be updated. [ 1136.762357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.762855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.763425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.763425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.763606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.774641] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: IN_PROGRESS for 2s [ 1136.783344] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.783666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.783666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.783823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.783892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.784099] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.784203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.784263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.784415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.784492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.784581] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1136.810634] env[65162]: INFO networking_nsxv3.common.synchronization [req-90f014f0-133e-4d63-9da0-61f8d42c65cb req-311e7545-83be-4a72-a8c4-eba61ecad066 service nova] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1136.810837] env[65162]: INFO networking_nsxv3.common.synchronization [req-90f014f0-133e-4d63-9da0-61f8d42c65cb req-311e7545-83be-4a72-a8c4-eba61ecad066 service nova] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1136.810977] env[65162]: INFO networking_nsxv3.common.synchronization [req-90f014f0-133e-4d63-9da0-61f8d42c65cb req-311e7545-83be-4a72-a8c4-eba61ecad066 service nova] Enqueued Resource ID: 224c840b-a4b3-466d-91d9-b61374609e3c with Priority: HIGHEST for action port [ 1136.811570] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_rules [ 1136.811704] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1136.811801] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 224c840b-a4b3-466d-91d9-b61374609e3c with Priority: HIGHEST for action port [ 1136.812177] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.812386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.812501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.812731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.812848] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.813841] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.813970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.814219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-224c840b-a4b3-466d-91d9-b61374609e3c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.814422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.814537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.814745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.814859] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('224c840b-a4b3-466d-91d9-b61374609e3c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.816960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.817085] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.817172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.817362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.817532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.832773] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1137.320289] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.320601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.320822] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 224c840b-a4b3-466d-91d9-b61374609e3c with status ACTIVE [ 1137.321146] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.322091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.322091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.322091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.322091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.322408] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.324205] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.324205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.324205] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 224c840b-a4b3-466d-91d9-b61374609e3c is going to be updated. [ 1137.356321] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.356512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.356616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.356943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.357185] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.357445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-224c840b-a4b3-466d-91d9-b61374609e3c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.491737] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1137.491981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.492292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.492465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.492609] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.492757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.492824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.492985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.493081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.493169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.493260] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.998136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.998136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.998136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.998136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.998136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.998136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.998136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.998529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.998529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.998529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.999617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.999617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.999617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.999617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.999617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.999617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.999617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.999975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.999975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.999975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.000998] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.297816] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1138.297816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.504476] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c: rpc.has_security_group_logging(os_id): False [ 1138.527241] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.527332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.527420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.527596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.527732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.527997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.527997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.527997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.527997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.527997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.527997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.527997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.527997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.529457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.529457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.529457] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.529457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.529725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.529725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.529725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.529850] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1138.606124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.606320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.606320] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.606559] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.606720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.628657] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1138.790146] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1138.790683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.791178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.791690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.792938] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.793194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.793312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.793624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.793798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.794015] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.846358] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1138.846525] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 1138.847192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.298044] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.419247] env[65162]: INFO networking_nsxv3.common.synchronization [req-6ace34db-ca14-4ef4-8c97-11fecda2bf09 req-ea991b64-1e12-49e5-a5e9-89456fe9cbab tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 1139.419880] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a with Priority: HIGHEST for action security_group_members [ 1139.421667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.421667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.421667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.421821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.422087] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.422220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.426035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.426035] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29ad06f-d3bc-443d-9727-1f7cc59ff50a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.800736] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.855774] env[65162]: INFO networking_nsxv3.common.synchronization [req-aa4313c5-1a0f-4ed2-856b-b2da88937bfc req-1e90b416-2c52-4e36-9468-1c658c39d82a tempest-ServersNegativeTestMultiTenantJSON-421809744 tempest-ServersNegativeTestMultiTenantJSON-421809744-project-member] Enqueued Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_members [ 1139.856336] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGHEST for action security_group_members [ 1139.856684] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.856808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.856878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.857175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.857334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.857773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.857773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.857773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.857773] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.857930] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.931644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.931861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.931966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.932159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.932281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.932562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.932651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.932705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.932874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.932951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.933054] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a is going to be updated. [ 1139.967912] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.968140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.968233] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.968510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.968737] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.983101] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: IN_PROGRESS for 2s [ 1140.304414] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.304586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.304668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.304876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.304968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.305077] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be updated. [ 1140.331950] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.332034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.332115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.332359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.332534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.344270] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: IN_PROGRESS for 2s [ 1140.360726] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.361061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.361181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.361438] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.361812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.361812] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.361966] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.362020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.362256] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.362315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.362504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 is going to be updated. [ 1140.396649] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.396825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.396864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.397127] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.397334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.407571] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 in Status: IN_PROGRESS for 2s [ 1140.650776] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1140.650933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.437607] env[65162]: INFO networking_nsxv3.common.synchronization [req-8092fd2c-3b49-4194-ad17-7da4faeee47c req-7b30e829-90f0-482b-a79e-dbe9656483f7 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_members [ 1141.437911] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_members [ 1141.438079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.438264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.438294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.438587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.438782] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.438895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.438995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.439249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.439304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.439393] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.880601] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.880802] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.881133] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.881266] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.881543] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.881702] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.881815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.882048] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.882261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.882489] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.882785] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.882920] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.883062] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.883184] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.883402] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.883568] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.904998] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.905896] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.906144] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.906391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-256" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.906722] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.906927] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.907024] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.908894] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.908894] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.941971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.942278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.942440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.942678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.943068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.943324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.943464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.943531] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.943739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.943848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.943971] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f already deleted. [ 1141.944143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.994822] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a in Status: SUCCESS [ 1141.995028] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29ad06f-d3bc-443d-9727-1f7cc59ff50a deletion is rescheduled due to dependency. [ 1141.995157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29ad06f-d3bc-443d-9727-1f7cc59ff50a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.347268] env[65162]: INFO networking_nsxv3.common.synchronization [None req-97faab6a-32d7-4227-a01f-88c830746a7a None None] Enqueued Resource ID: f1b38e70-3989-4268-84a5-594735c4a2af with Priority: HIGHEST for action port [ 1142.347627] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b38e70-3989-4268-84a5-594735c4a2af with Priority: HIGHEST for action port [ 1142.348488] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b38e70-3989-4268-84a5-594735c4a2af taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.348758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b38e70-3989-4268-84a5-594735c4a2af" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.348946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b38e70-3989-4268-84a5-594735c4a2af" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.349305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b38e70-3989-4268-84a5-594735c4a2af" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.349477] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b38e70-3989-4268-84a5-594735c4a2af',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.356514] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.358458] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.358458] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.358458] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.410899] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.411129] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.411248] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.412229] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.412229] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.412229] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 not found, creating... [ 1142.412229] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.412229] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.412474] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.412587] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.412729] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.413126] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.413230] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.413288] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.413491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.413612] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.413749] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 is going to be created. [ 1142.415920] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 in Status: SUCCESS [ 1142.416147] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 deletion is rescheduled due to dependency. [ 1142.416207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.438342] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.438762] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.438762] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.438953] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.439199] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.439430] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.851877] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1b38e70-3989-4268-84a5-594735c4a2af [ 1142.852143] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.852307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.852359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.852551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.852641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.852739] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1b38e70-3989-4268-84a5-594735c4a2af already deleted. [ 1142.852817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b38e70-3989-4268-84a5-594735c4a2af" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.861736] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.161884] env[65162]: INFO networking_nsxv3.common.synchronization [req-8092fd2c-3b49-4194-ad17-7da4faeee47c req-e8c1f050-52c0-4692-89ae-689d98ca7f8b service nova] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_rules [ 1143.161884] env[65162]: INFO networking_nsxv3.common.synchronization [req-8092fd2c-3b49-4194-ad17-7da4faeee47c req-e8c1f050-52c0-4692-89ae-689d98ca7f8b service nova] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_members [ 1143.161884] env[65162]: INFO networking_nsxv3.common.synchronization [req-8092fd2c-3b49-4194-ad17-7da4faeee47c req-e8c1f050-52c0-4692-89ae-689d98ca7f8b service nova] Enqueued Resource ID: 60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 with Priority: HIGHEST for action port [ 1143.162370] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_rules [ 1143.162712] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_members [ 1143.162712] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 with Priority: HIGHEST for action port [ 1143.162964] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.163098] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.163159] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.163358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.163438] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.164889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.164889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.165015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.165099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.165283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.165379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.165558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.165611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.167361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.167471] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.168377] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.168852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.168852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.168852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.168852] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.364411] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05f11b06-d4ac-4526-b2b0-8dcd11c88e34: rpc.has_security_group_logging(os_id): False [ 1143.390209] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.390348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.390419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.390621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.390707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.390945] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.391055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.391119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.391270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.391345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.391430] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be updated. [ 1143.453083] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.454431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.454431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.454431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.454431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.472021] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: IN_PROGRESS for 2s [ 1143.671567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.671567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.671855] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.674245] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 with status ACTIVE [ 1143.674245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.674245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.674245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.674245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.674420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.674552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.674663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.674741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.674903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.674994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.675192] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.675441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.675441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.675570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.675721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.677030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909 is going to be updated. [ 1143.702751] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.702751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.702751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.702751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.702751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.702751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60f8a07d-d57d-4fdd-b5a1-0ed5b7d98909" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.174871] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.536525] env[65162]: INFO networking_nsxv3.common.synchronization [None req-3dc107b6-2091-480a-94cf-3ab1e1268ab4 None None] Enqueued Resource ID: 9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9 with Priority: HIGHEST for action port [ 1144.537058] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9 with Priority: HIGHEST for action port [ 1144.537365] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.537484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.537551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.537926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.537926] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.684319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.684742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.685329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.685681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.686028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.686375] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f is going to be created. [ 1144.721027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.721027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.721027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.721027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.721027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.733099] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f in Status: UNINITIALIZED for 2s [ 1145.042499] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9 [ 1145.042736] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.042862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.042919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.043215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.043301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.043422] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9 already deleted. [ 1145.043488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a62f51f-a2b4-47ba-8bd4-e1fc479bc4f9" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.488088] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1145.488088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.743940] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f in Status: SUCCESS [ 1146.744308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.744428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.744633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.744833] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.744950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.745029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.745194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.745803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.745803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.745803] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.248925] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.476344] env[65162]: INFO networking_nsxv3.common.synchronization [req-9e6414f1-15a4-4670-8fab-275227d5af7b req-acee88d7-fdcc-471f-80d1-c740c73b0226 tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1147.476623] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1147.476964] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.477099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.477171] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.477373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.477528] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.477627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.477689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.477947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.478196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.478283] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.577165] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5ae06698-2cac-4c8b-b0f5-a7f2ff88f309 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1147.577165] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1147.577165] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.577165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.577165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.577165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.577165] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.577165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.577165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.577165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.578323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.578602] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.757693] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f: rpc.has_security_group_logging(os_id): False [ 1147.780075] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.781377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.781377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.781377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.781377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.781377] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.781589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.781589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.781672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.781847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.781847] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f is going to be created. [ 1147.854725] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.854879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.854943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.855168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.855880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.873284] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f in Status: IN_PROGRESS for 2s [ 1147.982362] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.982532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.982605] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.982820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.982916] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.983544] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.983544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.983544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.983544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.983544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.983817] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1148.015065] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.019086] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.019086] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.019203] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.019539] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.019737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.020225] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.020523] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.020686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.021348] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.021459] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.021562] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.021669] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.021776] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.021899] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.022066] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.025094] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.025290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.025375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.025584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.025741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.040707] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1148.057611] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.057984] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.058184] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.058373] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-17" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.058712] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.058919] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.059067] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.061649] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.061649] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df764c8b-6894-4d77-ac9b-e47ed67ad1c3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.081921] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.082112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.082188] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.082403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.082510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.082718] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.082829] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.082897] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.083063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.083143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.083247] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be deleted. [ 1148.137168] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.139023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.139023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.139023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.139023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.139023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.563988] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.564325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.564463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.564869] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.565037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.565203] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port df764c8b-6894-4d77-ac9b-e47ed67ad1c3 not found, creating... [ 1148.565483] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.565708] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.565945] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.566219] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.566383] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.566696] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.566857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.566976] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.567230] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.567369] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.567520] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: df764c8b-6894-4d77-ac9b-e47ed67ad1c3 is going to be created. [ 1148.588430] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.588648] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.588739] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.589093] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.589402] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.590146] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.336860] env[65162]: INFO networking_nsxv3.common.synchronization [req-9e6414f1-15a4-4670-8fab-275227d5af7b req-3e4d41b8-1c80-4152-b08a-25ccb4dee54d service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 1149.337400] env[65162]: INFO networking_nsxv3.common.synchronization [req-9e6414f1-15a4-4670-8fab-275227d5af7b req-3e4d41b8-1c80-4152-b08a-25ccb4dee54d service nova] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1149.337611] env[65162]: INFO networking_nsxv3.common.synchronization [req-9e6414f1-15a4-4670-8fab-275227d5af7b req-3e4d41b8-1c80-4152-b08a-25ccb4dee54d service nova] Enqueued Resource ID: df764c8b-6894-4d77-ac9b-e47ed67ad1c3 with Priority: HIGHEST for action port [ 1149.338790] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_rules [ 1149.338790] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1149.338790] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df764c8b-6894-4d77-ac9b-e47ed67ad1c3 with Priority: HIGHEST for action port [ 1149.339092] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.339237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.339312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.339753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.339753] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.340617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.340723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.340917] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.341028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.341096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.341292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.341649] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df764c8b-6894-4d77-ac9b-e47ed67ad1c3',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.573631] env[65162]: INFO networking_nsxv3.common.synchronization [req-00578a08-4d84-4a68-9cb6-87897b4d9c7f req-0af3fcdf-9a1a-470b-b2b3-abf0c76db417 tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1149.574887] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1149.575416] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.575621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.575762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.575947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.576143] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.576311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.576413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.576593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.576724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.576789] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.846586] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.846841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.846947] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df764c8b-6894-4d77-ac9b-e47ed67ad1c3 with status ACTIVE [ 1149.847210] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.847316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.847390] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.847662] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.847777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.848322] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.848322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.848322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.848715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.848715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.848715] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.848890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.848890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.849341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.849341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.849341] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df764c8b-6894-4d77-ac9b-e47ed67ad1c3 is going to be updated. [ 1149.876480] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.876658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.876751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.876952] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.877123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.877297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df764c8b-6894-4d77-ac9b-e47ed67ad1c3" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.888623] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f in Status: SUCCESS [ 1149.888623] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.059775] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1150.059980] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 1150.059980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.060631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.060631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.060631] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.060810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.060841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.060992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.061096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.061721] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.079495] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.563525] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.581111] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.069702] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.086021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.086021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.086021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.086021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.086021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.086021] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1151.119026] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.119026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.119026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.119026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.119026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.133711] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1151.366635] env[65162]: INFO networking_nsxv3.common.synchronization [None req-6ec9e459-ebd1-41a4-808c-3e8e38cb0964 tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1151.368444] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1151.369205] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.369205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.369205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.369205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.369379] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.545053] env[65162]: INFO networking_nsxv3.common.synchronization [None req-a85ac449-f2d6-4a2e-98cf-849937c3c0ea tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1151.545856] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1151.546268] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.546398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.572771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.572771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.572771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.572771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.572771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.572771] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1151.619025] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.619025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.619025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.619025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.619025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.631091] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1151.897757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.897921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.898024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.899063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.899063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.899063] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 already deleted. [ 1151.899063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.899063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.899063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.899063] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.423799] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.423956] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.424064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.424281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.424352] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.425660] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 already deleted. [ 1152.425660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.147080] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1153.147464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.591154] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-c9462bdc-0b5b-4955-91a4-2398e0abd75b tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1153.591154] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1153.591154] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.591154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.591990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.592408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.592702] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.592967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.593296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.593563] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.593760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.593979] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.645481] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1153.645481] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.645651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.647019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.647019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.647019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.647019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.647019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.647019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.647019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.647019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.064920] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-972e3de2-21f5-4249-ac9d-4d869da656fd tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1154.065531] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1154.065896] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.066277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.097599] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.097599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.097599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.097806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.097932] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.098186] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.098292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.098389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.098525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.098604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.098693] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 already deleted. [ 1154.098776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.099019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.099146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.099308] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.099407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.099469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.099612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.099688] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.102067] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.150229] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.150576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.150576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.152013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.152013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.152013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.152013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.152462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.152462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.152462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.152544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.152571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.152665] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.507242] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-d56863d8-a782-449c-b94f-891a8708859b tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1154.507897] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1154.508261] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.508524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.607542] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.607784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.607948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.608272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.608427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.608718] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.608882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.609037] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.609178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.609263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.609359] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 already deleted. [ 1154.609577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.609664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.610903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.610903] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.610903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.610903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.610903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.610903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.611284] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.656440] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03c457f4-5193-48c8-99b4-9dd3e8a1a23d: rpc.has_security_group_logging(os_id): False [ 1154.678731] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.678885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.678978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.679220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.679474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.679765] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.679765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.679765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.680428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.681211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.681594] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.681837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.681943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.685394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.685394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.685394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.685394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.685394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.685394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.686939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.687137] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1154.758245] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.758435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.758472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.758735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.758920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.772705] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1154.976115] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.976317] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.976439] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.976775] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.977859] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.978115] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.978250] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.978497] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.978647] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.978931] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.979062] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.979171] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.979282] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.979398] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.979502] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.979634] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.002238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.002371] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.002493] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.002684] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.003358] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-e5af59ec-0252-420e-be66-38bb0031424a taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.003358] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.003358] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.003717] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.003768] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5af59ec-0252-420e-be66-38bb0031424a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.114337] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.114337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.114337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.114337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.114632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.114632] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.114710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.114710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.114851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.114928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.115032] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 already deleted. [ 1155.115114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.505968] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.506306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.506346] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.506591] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.506737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.506889] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port e5af59ec-0252-420e-be66-38bb0031424a not found, creating... [ 1155.507176] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.507591] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.507716] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.508026] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.508192] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.508520] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.508680] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.508797] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.509015] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.509259] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.509445] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: e5af59ec-0252-420e-be66-38bb0031424a is going to be created. [ 1155.530541] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.530684] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.533020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.533020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.533020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.533020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.268616] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-2967dbfd-ead8-4fbf-94ab-f455a6f5b191 service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1156.268935] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-2967dbfd-ead8-4fbf-94ab-f455a6f5b191 service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1156.269095] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-2967dbfd-ead8-4fbf-94ab-f455a6f5b191 service nova] Enqueued Resource ID: e5af59ec-0252-420e-be66-38bb0031424a with Priority: HIGHEST for action port [ 1156.270300] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1156.270544] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1156.270677] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af59ec-0252-420e-be66-38bb0031424a with Priority: HIGHEST for action port [ 1156.270996] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.271156] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.271203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.271578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.271578] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.274031] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.274163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.274232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.274423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.274586] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.274664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.274726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.276075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.276075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.276234] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.278348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5af59ec-0252-420e-be66-38bb0031424a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.278513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.278513] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.279289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.279289] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5af59ec-0252-420e-be66-38bb0031424a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.775254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.775576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.781222] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5af59ec-0252-420e-be66-38bb0031424a with status ACTIVE [ 1156.781837] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.781837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.781837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.781837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.782110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.782110] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.782241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.782291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.782985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.782985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.782985] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.782985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.782985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.782985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.782985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.783276] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5af59ec-0252-420e-be66-38bb0031424a is going to be updated. [ 1156.784207] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.790915] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1156.790915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.814746] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.814936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.815033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.815362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.816014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.816014] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5af59ec-0252-420e-be66-38bb0031424a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.128621] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.128847] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-258" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.128973] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-258" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.129559] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-258" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.129649] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.129760] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.129898] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.130172] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.130393] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.130783] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.130901] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.131043] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.131174] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.131265] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.131475] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.131595] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.151683] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.151864] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.152013] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.152215] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-258" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.153131] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.153387] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.153501] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.153825] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.153960] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.286548] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.656425] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.656641] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.656803] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.657226] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.657527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.657714] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e not found, creating... [ 1157.658296] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.658566] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.658700] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.659067] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.659200] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.659528] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.659753] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.659882] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.660117] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.660278] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.660420] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e is going to be created. [ 1157.682110] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.682335] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.682446] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.682713] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.682947] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.683193] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.788900] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.789405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.789405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.789405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.789597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.789597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be created. [ 1157.830198] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.830479] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.830613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.830946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.831252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.844651] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: UNINITIALIZED for 2s [ 1158.116259] env[65162]: INFO networking_nsxv3.common.synchronization [req-bdd218f9-f0c1-4d7c-94a4-2ac8450d3b71 req-03349f8a-052f-4f63-8e9d-5680383be94f tempest-ServersTestJSON-2141450014 tempest-ServersTestJSON-2141450014-project-member] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1158.116782] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGHEST for action security_group_members [ 1158.117110] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.117235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.117294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.117494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.117643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.117740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.117800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.117992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.118108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.118191] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.386666] env[65162]: INFO networking_nsxv3.common.synchronization [req-9f2e9da5-f62c-4db4-ae29-12dc303e48c1 req-1deb6abe-48a1-4e6e-8de7-5e30318043e8 tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1158.387877] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1158.388260] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.388387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.388474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.388756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.388949] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.389095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.389161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.389323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.389409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.389517] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.393362] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-56112524-89bb-40bc-be5d-db18a7360a0e service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1158.393564] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-56112524-89bb-40bc-be5d-db18a7360a0e service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1158.393682] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-56112524-89bb-40bc-be5d-db18a7360a0e service nova] Enqueued Resource ID: 0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e with Priority: HIGHEST for action port [ 1158.394183] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1158.394328] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1158.394675] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e with Priority: HIGHEST for action port [ 1158.394942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.396106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.396397] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.396508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.401265] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.401448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.401521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.401731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.401818] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.620937] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.621166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.621266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.621515] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.621613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.621849] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.621969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.622047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.622280] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.622371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.622491] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be updated. [ 1158.655968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.656136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.656207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.656707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.656943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.667704] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: IN_PROGRESS for 2s [ 1158.790957] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.791196] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.791196] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.791414] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.791661] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.791815] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.791928] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.792615] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.792769] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.793015] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.793158] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.795173] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.795173] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.795173] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.795173] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.795173] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.815802] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.816066] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1158.816217] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.816477] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.816839] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-e0d3d9ce-b80f-4495-9be8-e3763d50525c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.817041] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.817232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.817563] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.817701] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d3d9ce-b80f-4495-9be8-e3763d50525c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.891861] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.892036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.892116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.892332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.892418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.892615] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.892706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.892767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.892906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.892980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.893078] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 already deleted. [ 1158.893157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.904051] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e with status ACTIVE [ 1158.904264] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.904386] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.904455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.904640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.904726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.904896] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.904992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.905220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.905407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.905498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.905695] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.905797] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.905860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.906045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.906133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.906223] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e is going to be updated. [ 1158.928023] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.928196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.928236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.928439] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.928570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.928722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e325b8e-bbf5-4b3d-b7e4-ff30489cc66e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.270184] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.270489] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.270665] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.271233] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.271673] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.271938] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.272115] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.272410] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.272592] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.272849] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.272996] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.273156] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.273298] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.273440] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.273579] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.273754] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.297356] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.297576] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.297645] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.297818] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-46" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.298265] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-561a7188-22d0-4edf-868b-60ee1400c679 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.298496] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.298647] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.299022] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.299206] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('561a7188-22d0-4edf-868b-60ee1400c679',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.321080] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.321294] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.321413] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.321684] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.321833] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.321984] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port e0d3d9ce-b80f-4495-9be8-e3763d50525c not found, creating... [ 1159.322258] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.322411] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.322525] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.322737] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.322869] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.323155] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.323307] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.323421] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.323620] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.323759] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.323883] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c is going to be created. [ 1159.353937] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.354207] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.354332] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.354621] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.354860] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.355199] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.801436] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.801816] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.801816] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.802034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.802189] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.802336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 561a7188-22d0-4edf-868b-60ee1400c679 not found, creating... [ 1159.802591] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.802746] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.802861] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.803213] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.803354] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.803637] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.803791] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.803907] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.804126] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.804260] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.804393] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 561a7188-22d0-4edf-868b-60ee1400c679 is going to be created. [ 1159.824735] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.825063] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.825254] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.825580] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.825897] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.826204] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.857904] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1159.858289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.858504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.858837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.859136] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.859306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.859403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.859636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.859750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.859874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.860026] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.861178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.861395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.861620] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.861760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.861847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.862049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.862865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.862865] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.082241] env[65162]: INFO networking_nsxv3.common.synchronization [req-9f2e9da5-f62c-4db4-ae29-12dc303e48c1 req-66523eb8-3fb7-4fe5-9f8f-68d7c5c2116a service nova] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1160.082241] env[65162]: INFO networking_nsxv3.common.synchronization [req-9f2e9da5-f62c-4db4-ae29-12dc303e48c1 req-66523eb8-3fb7-4fe5-9f8f-68d7c5c2116a service nova] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1160.082241] env[65162]: INFO networking_nsxv3.common.synchronization [req-9f2e9da5-f62c-4db4-ae29-12dc303e48c1 req-66523eb8-3fb7-4fe5-9f8f-68d7c5c2116a service nova] Enqueued Resource ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c with Priority: HIGHEST for action port [ 1160.082241] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1160.082536] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1160.082536] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c with Priority: HIGHEST for action port [ 1160.082761] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.082761] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.082980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.083052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.083113] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.083983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.084169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.084219] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.084345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.084510] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.084646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.084706] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.084806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.084910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.084998] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.085779] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0d3d9ce-b80f-4495-9be8-e3763d50525c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.085886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.086066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.086135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.086212] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d3d9ce-b80f-4495-9be8-e3763d50525c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.364557] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.364728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.365041] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.546138] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-e4693832-8030-413a-bb3f-483b6dd44d3f service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1160.546323] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-e4693832-8030-413a-bb3f-483b6dd44d3f service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1160.546462] env[65162]: INFO networking_nsxv3.common.synchronization [req-ff7c37c7-1165-43f1-b759-e0c2c53a8de1 req-e4693832-8030-413a-bb3f-483b6dd44d3f service nova] Enqueued Resource ID: 561a7188-22d0-4edf-868b-60ee1400c679 with Priority: HIGHEST for action port [ 1160.546923] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1160.547074] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1160.547173] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 561a7188-22d0-4edf-868b-60ee1400c679 with Priority: HIGHEST for action port [ 1160.547496] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.547837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.548021] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.548149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.548401] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-561a7188-22d0-4edf-868b-60ee1400c679 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.548571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.548894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.548894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.548975] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('561a7188-22d0-4edf-868b-60ee1400c679',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.588406] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.589701] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.589823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.590597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0d3d9ce-b80f-4495-9be8-e3763d50525c with status ACTIVE [ 1160.590825] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.590939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.590976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.591217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.591308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.591481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.591580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.591642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.591794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.591889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.593457] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.593457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.593457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.593457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.593457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.593457] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c is going to be updated. [ 1160.616107] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.616348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.616429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.616721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.616879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.617140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.680995] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c in Status: SUCCESS [ 1160.681259] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c deletion is rescheduled due to dependency. [ 1160.681404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.867466] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.051046] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 561a7188-22d0-4edf-868b-60ee1400c679 with status ACTIVE [ 1161.051441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.051532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.051603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.051906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.052034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.052300] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.052380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.052432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.052560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.052640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.052818] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.052910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.052963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.053121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.053198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.053286] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 561a7188-22d0-4edf-868b-60ee1400c679 is going to be updated. [ 1161.073621] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.073807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.073807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.073985] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.074136] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.074300] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-561a7188-22d0-4edf-868b-60ee1400c679" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.091797] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.105367] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.105573] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.105699] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.106018] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.106296] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.106614] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.106738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.106955] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.107115] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.107320] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.107432] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.107540] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.107646] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.107753] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.107862] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.108145] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.132492] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.132708] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1161.132849] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.133037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.133359] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-a5bed245-b53d-4c73-b69d-bee49df1fc95 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.133536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.133658] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.134132] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.134307] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5bed245-b53d-4c73-b69d-bee49df1fc95',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.370336] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.370505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.370551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.371361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.371361] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.371361] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1161.401169] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.401324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.401431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.401607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.402063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.410654] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1161.594114] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.594314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.594314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.594550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.594683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.594813] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 is going to be created. [ 1161.617730] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.618039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.618039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.618200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.618368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.627691] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: UNINITIALIZED for 2s [ 1161.637779] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.638051] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.638199] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.638463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.638608] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.638756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port a5bed245-b53d-4c73-b69d-bee49df1fc95 not found, creating... [ 1161.639060] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.639267] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.639391] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.639604] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.639740] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.640033] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.640355] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.640502] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.640706] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.640844] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.640981] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 is going to be created. [ 1161.660067] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.660288] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.660424] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.660693] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.660920] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.661191] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.382577] env[65162]: INFO networking_nsxv3.common.synchronization [req-5ad1c0bf-6566-4000-b9e3-a4e5d9926dcd req-c4b46fed-f7b2-461e-9dbe-3ba7ed009b70 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1162.382940] env[65162]: INFO networking_nsxv3.common.synchronization [req-5ad1c0bf-6566-4000-b9e3-a4e5d9926dcd req-c4b46fed-f7b2-461e-9dbe-3ba7ed009b70 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1162.383126] env[65162]: INFO networking_nsxv3.common.synchronization [req-5ad1c0bf-6566-4000-b9e3-a4e5d9926dcd req-c4b46fed-f7b2-461e-9dbe-3ba7ed009b70 service nova] Enqueued Resource ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 with Priority: HIGHEST for action port [ 1162.383601] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1162.383731] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1162.383854] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 with Priority: HIGHEST for action port [ 1162.384581] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.384719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.384784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.384991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.385092] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.386786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.386938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.387024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.387216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.387371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.387475] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.387543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.387683] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.387767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.387862] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.389794] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5bed245-b53d-4c73-b69d-bee49df1fc95 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.389921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.389975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.390133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.390212] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5bed245-b53d-4c73-b69d-bee49df1fc95',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.891476] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.892591] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.892704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.892882] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5bed245-b53d-4c73-b69d-bee49df1fc95 with status ACTIVE [ 1162.893051] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.893161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.893226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.893429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.893514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.893892] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.894054] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.894130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.894307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.894377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.894570] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.894669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.894733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.894914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.894960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.895047] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 is going to be updated. [ 1162.927506] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.927708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.927708] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.927921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.928143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.928312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.181302] env[65162]: INFO networking_nsxv3.common.synchronization [req-f11b38ee-96c1-4d98-9de6-7b61dd0efc14 req-d1cbe0e1-e3cc-4642-8188-64853bb318e2 tempest-ServerRescueTestJSON-2134412146 tempest-ServerRescueTestJSON-2134412146-project-member] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1163.182303] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1163.182303] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.182303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.182303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.182702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.182702] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.182702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.182803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.183099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.183099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.183099] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.396677] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.420075] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1163.420347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.420550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.420775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.420990] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.422474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.422474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.422474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.423030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.423030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.423030] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.423498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.423660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.423806] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.423906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.423962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.424119] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.424227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.424279] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.637276] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: SUCCESS [ 1163.637520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.637679] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.637902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.638155] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.638267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.638328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.638487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.638569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.638652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.638744] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.685124] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.899319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.899549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.899549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.899763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.899861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.899955] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be created. [ 1163.924494] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.925068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.925068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.925068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.925201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.926273] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d4e4d48-63e4-4263-8005-29e70b0f2891: rpc.has_security_group_logging(os_id): False [ 1163.927172] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.937187] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: UNINITIALIZED for 2s [ 1163.945222] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.945747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.945747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.945747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.945747] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.945975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.946089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.946168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.946328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.946461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.946612] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.946712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.946779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.946923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.947214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.948254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.948363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.948435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.948616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.948701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.948793] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be created. [ 1164.010877] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.011745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.011745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.011745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.011745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.023132] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1164.141385] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.187853] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.430314] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.644025] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 055c27af-8eff-41f6-aced-6244f2d29090: rpc.has_security_group_logging(os_id): False [ 1164.663974] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.664172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.664230] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.664415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.664504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.664743] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.664844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.664960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.665058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.665134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.665219] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 is going to be created. [ 1164.690733] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.690733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.690733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.690931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.690980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.691102] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be updated. [ 1164.724520] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.724796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.724796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.725108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.725322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.736242] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: IN_PROGRESS for 2s [ 1164.745368] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.745527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.745603] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.745821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.746134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.769927] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: IN_PROGRESS for 2s [ 1164.933120] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.933335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.933335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.933589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.933671] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.933778] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1164.964225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.964440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.964440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.964647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.964793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.973985] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1165.947727] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1165.948131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.948131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.948451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.948667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.948831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.948921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.949150] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.949257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.949368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.949480] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.036081] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1166.036302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.036471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.036698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.036785] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.452091] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.452315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.452315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.452509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.452729] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.452868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.452936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.453108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.453201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.453292] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.453485] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.453588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.453657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.453806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.453946] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.454055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.454179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.454254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.454328] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.454407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.454500] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.539448] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.539654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.749688] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1166.749935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.782409] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: SUCCESS [ 1166.782409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.957074] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7fd6bec-6820-40d4-9564-ee5cb9c2521e: rpc.has_security_group_logging(os_id): False [ 1166.974865] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.975055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.975120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.975362] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.975462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.975691] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.975793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.975857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.976195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.976293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.976494] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.976600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.976666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.976823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.976915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.977129] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.977250] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.977315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.977463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.977539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.977628] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be created. [ 1166.989410] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1166.989655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.989820] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.990049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.990244] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.990363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.990439] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.990599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.990678] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.990764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.990856] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.038682] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.038921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.039780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.039780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.039780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.053164] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1167.493168] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.493348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.493417] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.493622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.493797] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.493899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.493967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.494162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.494261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.494350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.494499] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.494592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.494727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.494785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.494909] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.495016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.495072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.495194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.495268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495443] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.997575] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d4e4d48-63e4-4263-8005-29e70b0f2891: rpc.has_security_group_logging(os_id): False [ 1168.016253] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.016463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.016463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.016690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.016780] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.016971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.017087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.017151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.017303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.017389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.017568] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.017660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.017718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.017850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.017922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.018354] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.018503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.018670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.018714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.018757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.019044] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1168.091864] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.091864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.091864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.092436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.092601] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.109521] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1168.183070] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1168.183255] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1169.069011] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1169.069419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.078987] env[65162]: INFO networking_nsxv3.common.synchronization [req-fc91a501-44f6-4b31-957d-c15989729beb req-0284638a-bf36-4218-a33c-06ff910f94ad tempest-ServerRescueTestJSON-2134412146 tempest-ServerRescueTestJSON-2134412146-project-member] Enqueued Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1170.079799] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f with Priority: HIGHEST for action security_group_members [ 1170.079969] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05adefa-98e3-4c1c-adb3-589d73d33b2f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.080104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.080172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.080444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.080617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.080769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.080810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.080950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.081050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.081147] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05adefa-98e3-4c1c-adb3-589d73d33b2f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.125659] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1170.125888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.126076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.126346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.126438] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.584199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.584431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.584431] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.584586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.584677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.584873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.584973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.585051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.585235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.585319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.585411] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f is going to be updated. [ 1170.619910] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.621077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.621077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.621077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.621077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.629715] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.629889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.629972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.630210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.630501] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.630653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.630740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.630903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.631033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.631149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.631244] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.633750] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: IN_PROGRESS for 2s [ 1171.023840] env[65162]: INFO networking_nsxv3.common.synchronization [req-42601eff-f2a0-4914-b9be-1c7355f252c0 req-db74e029-51d5-40a7-be76-7c4c591b369f tempest-ServerDiskConfigTestJSON-1022058155 tempest-ServerDiskConfigTestJSON-1022058155-project-member] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1171.024444] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGHEST for action security_group_members [ 1171.024760] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.024881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.024947] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.025163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.025321] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.025420] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.025666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.025666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.025778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.025843] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.134215] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.134620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.134620] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.134721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.134788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.134989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.134989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.135101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.135187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.135441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.135441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.135542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.135633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.135738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.135886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.135995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.136051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.136350] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.136445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.136540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.136637] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.529086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.529086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.529086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.529086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.529516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.529516] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.529516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.529676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.529739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.529786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.529856] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be updated. [ 1171.557940] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.558177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.558229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.558406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.558554] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.570109] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: IN_PROGRESS for 2s [ 1171.639475] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d4e4d48-63e4-4263-8005-29e70b0f2891: rpc.has_security_group_logging(os_id): False [ 1171.658889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.659088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.659168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.659440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.659539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.659732] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.659830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.659894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.660084] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.660132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.660336] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.660439] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.660495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.660636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.660711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.660882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.660974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.661476] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.661828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.661828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.661914] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1171.725726] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.725982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.725982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.726222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.726371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.743198] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1172.647084] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f in Status: SUCCESS [ 1172.647389] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05adefa-98e3-4c1c-adb3-589d73d33b2f deletion is rescheduled due to dependency. [ 1172.647467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05adefa-98e3-4c1c-adb3-589d73d33b2f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.581456] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d in Status: SUCCESS [ 1173.581650] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d deletion is rescheduled due to dependency. [ 1173.581755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.761221] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1173.762166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.002973] env[65162]: INFO networking_nsxv3.common.synchronization [req-c102872b-8dd8-4f7b-932d-134c5687e769 req-ff316b40-b712-4f4d-8db4-d46525690d84 tempest-DeleteServersTestJSON-701300352 tempest-DeleteServersTestJSON-701300352-project-member] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1174.003516] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGHEST for action security_group_members [ 1174.003829] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.003949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.004025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.004220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.004375] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.004514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.004571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.004733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.004784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.004856] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.507363] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.507456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.507538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.507724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.507817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.508019] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.508182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.508266] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.508429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.508532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.508599] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be updated. [ 1174.541373] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.541566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.541691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.541993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.542102] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.553030] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: IN_PROGRESS for 2s [ 1175.197190] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f04ab28-257c-4aaf-a523-4d4f0287842b req-33e7db92-f581-4974-8179-47653c937a22 tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1175.197751] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1175.198324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.198655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.198969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.199398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.199398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.199516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.199516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.199652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.199767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.199861] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.419102] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f04ab28-257c-4aaf-a523-4d4f0287842b req-09e79012-2a3e-48e5-8b2d-d0e88086796f tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1175.420537] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1175.420991] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.421196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.645551] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f04ab28-257c-4aaf-a523-4d4f0287842b req-15951919-0492-4eca-b0b3-055e6b883f77 tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1175.645551] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1175.645551] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.645551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.702858] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.204917] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.571195] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 in Status: SUCCESS [ 1176.571195] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 deletion is rescheduled due to dependency. [ 1176.571195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.709346] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.709969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.709969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.709969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.709969] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.710283] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1176.739347] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.739347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.739347] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.739562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.739628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.751434] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1178.762305] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1178.764654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.764654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.764654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.764654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.766019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.766019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.766019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.766019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.766019] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.017663] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.017855] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.018795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.018795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.018795] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.018795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.018795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.019250] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.019250] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.022035] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.022035] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.022035] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.022035] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.022035] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.022035] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.022035] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.040855] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.041055] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.041179] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.041385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-470" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.041695] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-a5bed245-b53d-4c73-b69d-bee49df1fc95 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.041872] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.042043] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.042841] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.042841] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5bed245-b53d-4c73-b69d-bee49df1fc95',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.268640] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.268813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.268863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.269114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.269220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.269450] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.269561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.269628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.269789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.269870] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.269960] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1179.297339] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.297541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.297541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.297675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.298077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.307036] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1179.550028] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.550028] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.550028] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.550557] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.550557] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.550557] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.551264] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.551644] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.551956] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 is going to be updated. [ 1179.575054] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.575054] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.575418] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.575879] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.577027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.577027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.276898] env[65162]: INFO networking_nsxv3.common.synchronization [req-12c73ba9-4da0-4666-b923-9a4f69c73c01 req-3f021869-f477-4b32-a846-675508a98409 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1180.276898] env[65162]: INFO networking_nsxv3.common.synchronization [req-12c73ba9-4da0-4666-b923-9a4f69c73c01 req-3f021869-f477-4b32-a846-675508a98409 service nova] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1180.276898] env[65162]: INFO networking_nsxv3.common.synchronization [req-12c73ba9-4da0-4666-b923-9a4f69c73c01 req-3f021869-f477-4b32-a846-675508a98409 service nova] Enqueued Resource ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 with Priority: HIGHEST for action port [ 1180.280860] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_rules [ 1180.280860] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1180.280860] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 with Priority: HIGHEST for action port [ 1180.280860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.280860] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.280860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.280860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.280860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.280860] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.280860] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5bed245-b53d-4c73-b69d-bee49df1fc95 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.281677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.281677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.284798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.284798] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5bed245-b53d-4c73-b69d-bee49df1fc95',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.786919] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.786919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.787045] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.787884] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5bed245-b53d-4c73-b69d-bee49df1fc95 with status ACTIVE [ 1180.788486] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.788486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.788486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.788486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.788742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.788742] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.788812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.788844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.789051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.789051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.789266] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.789428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.789428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.789538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.789611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.790615] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5bed245-b53d-4c73-b69d-bee49df1fc95 is going to be updated. [ 1180.815179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.815393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.815393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.815647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.815740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.815884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5bed245-b53d-4c73-b69d-bee49df1fc95" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.291628] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.321306] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1181.321306] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 deletion is rescheduled due to dependency. [ 1181.321306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.321306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.321306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.321573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.321979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.322165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.322422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.322599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.322792] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.793952] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.794095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.795052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.795052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.795052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.795052] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1181.825365] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.825673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.825772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.826023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.826146] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.826406] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.826556] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.826643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.826826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.826931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.827056] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1181.833876] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.834000] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.834147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.834288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.834445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.849376] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1181.866663] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.866851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.866924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.867161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.867304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.876578] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1183.123023] env[65162]: INFO networking_nsxv3.common.synchronization [req-9b46c63a-255c-4520-80e1-4e8962688823 req-5d914cdd-b545-44e6-be59-eb83fde3d473 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_members [ 1183.123598] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGHEST for action security_group_members [ 1183.123954] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.124261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.124346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.124589] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.124771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.124937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.124937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.125116] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.125215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.125311] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.629677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.629677] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.629677] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.629677] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a is going to be updated. [ 1183.662437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.662437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.662437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.662437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.662437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.672850] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a in Status: IN_PROGRESS for 2s [ 1183.860546] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1183.861248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.861429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.861654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.861857] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.861967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.862040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.862227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.862312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.862383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.862484] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.885625] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1183.885816] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 deletion is rescheduled due to dependency. [ 1183.885946] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.365247] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.365580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.365580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.365791] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.365850] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.365933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.365995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.366175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.366275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.366374] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.366525] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.366618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.366675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.366815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.366949] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.367049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.367182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.367315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.367315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.367426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.367471] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.870751] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7fd6bec-6820-40d4-9564-ee5cb9c2521e: rpc.has_security_group_logging(os_id): False [ 1184.888454] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.888592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.888668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.888873] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.888967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.889235] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.889344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.889408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.889564] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.889641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.889816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.889911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.889974] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.890147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.890195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.890370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.890462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.890524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.890661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.890734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.890818] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1184.950437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.950609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.950689] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.950902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.951073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.966281] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1185.685510] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a in Status: SUCCESS [ 1185.685826] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a deletion is rescheduled due to dependency. [ 1185.685826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.859075] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-116406e4-38a8-4aef-bd38-1aa660ca6167 tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1186.859680] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1186.859813] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.859939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.860061] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.860204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.860394] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.860523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.860607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.860702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.860795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.860872] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.982370] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1186.982370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.144302] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-7325d1a8-97a9-4e13-9f37-d32f4d832e82 tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1187.145229] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1187.145554] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.145945] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.362961] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.363140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.363216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.363723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.363843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.364079] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.364191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.364258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.364440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.364520] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.364612] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1187.392029] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.392176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.392245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.392401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.392546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.403601] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1187.442886] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.443188] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.443320] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.443652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.443931] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.444107] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.444232] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.444494] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.444649] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.444866] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.445014] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.445136] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.445243] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.445354] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.445460] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.445588] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.464399] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.464614] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1187.464759] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.464939] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-503" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.465276] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-8a4e9417-071d-4b2f-a9b1-43e9038ad539 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.465488] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.465610] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.465937] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.466097] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a4e9417-071d-4b2f-a9b1-43e9038ad539',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.968325] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.968687] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.968741] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.969084] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.969292] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.969406] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 8a4e9417-071d-4b2f-a9b1-43e9038ad539 not found, creating... [ 1187.969675] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.969829] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.969942] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.970229] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.970380] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.970796] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.970969] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.971112] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.971328] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.971462] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.971597] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 8a4e9417-071d-4b2f-a9b1-43e9038ad539 is going to be created. [ 1187.994727] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.994950] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.995092] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.995378] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.995660] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.995888] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.731135] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-97e41c9a-7f9f-4061-b9b5-16431e2273a0 service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1188.731135] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-97e41c9a-7f9f-4061-b9b5-16431e2273a0 service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1188.731135] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-97e41c9a-7f9f-4061-b9b5-16431e2273a0 service nova] Enqueued Resource ID: 8a4e9417-071d-4b2f-a9b1-43e9038ad539 with Priority: HIGHEST for action port [ 1188.731135] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1188.731135] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1188.731135] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e9417-071d-4b2f-a9b1-43e9038ad539 with Priority: HIGHEST for action port [ 1188.731135] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.731135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.731135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.731789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.731789] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.736039] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.736039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.736039] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a4e9417-071d-4b2f-a9b1-43e9038ad539 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.736039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.736039] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.736981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.736981] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a4e9417-071d-4b2f-a9b1-43e9038ad539',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.242149] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.242149] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.242149] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a4e9417-071d-4b2f-a9b1-43e9038ad539 with status ACTIVE [ 1189.242547] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.242547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.242547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.242670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.242705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.242889] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.242988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.243066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.243217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.243297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.243481] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.243571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.243635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.243777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.243853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.243940] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a4e9417-071d-4b2f-a9b1-43e9038ad539 is going to be updated. [ 1189.268044] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.268235] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.268272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.268772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.268772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.268924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a4e9417-071d-4b2f-a9b1-43e9038ad539" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.415349] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1189.415555] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 deletion is rescheduled due to dependency. [ 1189.415658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.415815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.416040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.416254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.416382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.416451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.416610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.416690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.416789] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.542356] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.542624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-238" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.542761] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-238" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.543107] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-238" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.543715] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.543882] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.544010] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.544236] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.544381] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.544615] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.544741] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.544849] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.544958] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.545080] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.545202] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.545312] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.563803] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.563967] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1189.564112] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.564293] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-238" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.564619] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-b8790d53-28bb-4c5d-b21e-c6714726a321 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.564787] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.564904] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.565236] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.565375] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8790d53-28bb-4c5d-b21e-c6714726a321',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.921796] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.068020] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.068020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.068210] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.068571] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.068728] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.068884] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port b8790d53-28bb-4c5d-b21e-c6714726a321 not found, creating... [ 1190.069207] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.069432] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.069632] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.069903] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.070068] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.070383] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.070545] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.070667] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.070883] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.071040] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.071250] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: b8790d53-28bb-4c5d-b21e-c6714726a321 is going to be created. [ 1190.091628] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.091837] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.091962] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.092251] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.092489] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.092716] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.424130] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.831240] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-01ef2788-1283-4131-9048-9d9f2c3a2058 service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1190.831240] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-01ef2788-1283-4131-9048-9d9f2c3a2058 service nova] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1190.831240] env[65162]: INFO networking_nsxv3.common.synchronization [req-fdbfb5b4-e10d-49d3-8024-e472ab3eb980 req-01ef2788-1283-4131-9048-9d9f2c3a2058 service nova] Enqueued Resource ID: b8790d53-28bb-4c5d-b21e-c6714726a321 with Priority: HIGHEST for action port [ 1190.831639] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_rules [ 1190.831780] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1190.831874] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8790d53-28bb-4c5d-b21e-c6714726a321 with Priority: HIGHEST for action port [ 1190.832174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.832274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.832475] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.832545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.832717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8790d53-28bb-4c5d-b21e-c6714726a321 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.832815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.832877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.833095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.833177] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8790d53-28bb-4c5d-b21e-c6714726a321',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.927713] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.927713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.927713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.928018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.928057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.928141] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1190.972637] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.972850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.972850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.973077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.973223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.981956] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1191.335072] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8790d53-28bb-4c5d-b21e-c6714726a321 with status ACTIVE [ 1191.335182] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.335305] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.335373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.335597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.335690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.335873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.335975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.336050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.336212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.336358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.336562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.336648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.336709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.336848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.336921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.337009] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8790d53-28bb-4c5d-b21e-c6714726a321 is going to be updated. [ 1191.359798] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.359942] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.360027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.360372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.360372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.360537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8790d53-28bb-4c5d-b21e-c6714726a321" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.993853] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1192.994184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.994398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.994569] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.994757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.994881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.994951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.995143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.995220] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.995317] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.497430] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.999575] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.434169] env[65162]: INFO networking_nsxv3.common.synchronization [req-6a399e4e-9f50-45db-924f-90f664a1fe11 req-389ce375-f617-434b-a433-7b1ce7913d5d tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 1194.434726] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 1194.435034] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.435162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.435232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.435430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.435576] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.435663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.435730] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.435877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.435964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.436070] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.501928] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.502179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.502179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.502403] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.502440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.502542] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1194.531987] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.532162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.532231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.532641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.532641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.542567] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1194.745896] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.746156] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.746306] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.746633] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.746915] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.749068] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.749639] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.750780] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.751027] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.751349] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.751750] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.751750] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.751849] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.751950] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.752729] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.752809] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.773587] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.773889] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1194.774054] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.774263] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.774601] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-39798e5b-78c7-4e8e-b304-997aec8b5b53 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.774879] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.774968] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.775382] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.775586] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39798e5b-78c7-4e8e-b304-997aec8b5b53',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.939949] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.939949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.939949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.939949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.939949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.940902] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.940902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.940902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.940902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.940902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.940902] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be deleted. [ 1194.970041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.970265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.970265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.970422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.970517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.970617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.278862] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.279190] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.279240] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.279676] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.279820] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.279913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 39798e5b-78c7-4e8e-b304-997aec8b5b53 not found, creating... [ 1195.280210] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.280370] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.280511] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.280784] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.280903] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.281278] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.281367] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.281469] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.281697] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.281864] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.282015] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 is going to be created. [ 1195.313198] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.313536] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.313621] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.313949] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.314267] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.314532] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.034382] env[65162]: INFO networking_nsxv3.common.synchronization [req-6a399e4e-9f50-45db-924f-90f664a1fe11 req-6327fb1c-13c7-4868-a447-8fe1aef1e0b8 service nova] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_rules [ 1196.034382] env[65162]: INFO networking_nsxv3.common.synchronization [req-6a399e4e-9f50-45db-924f-90f664a1fe11 req-6327fb1c-13c7-4868-a447-8fe1aef1e0b8 service nova] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 1196.034382] env[65162]: INFO networking_nsxv3.common.synchronization [req-6a399e4e-9f50-45db-924f-90f664a1fe11 req-6327fb1c-13c7-4868-a447-8fe1aef1e0b8 service nova] Enqueued Resource ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 with Priority: HIGHEST for action port [ 1196.034592] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_rules [ 1196.034868] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 1196.034962] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 with Priority: HIGHEST for action port [ 1196.035254] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.035376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.035445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.035707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.035798] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.037124] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.037244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.037314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.037592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.037751] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.037849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.037914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.038073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.038161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.038254] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.039179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-39798e5b-78c7-4e8e-b304-997aec8b5b53 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.039330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.039424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.039653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.039780] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39798e5b-78c7-4e8e-b304-997aec8b5b53',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.464631] env[65162]: INFO networking_nsxv3.common.synchronization [req-86c10ea7-c676-47e2-9c72-fa1b8fb70c3f req-477cd53a-24d8-489b-9209-c50eac8668c3 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1196.465178] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1196.465562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.465701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.465764] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.466016] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.466192] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.466335] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.466409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.466599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.466719] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.466757] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.542968] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.543162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.544324] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.545239] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39798e5b-78c7-4e8e-b304-997aec8b5b53 with status ACTIVE [ 1196.545437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.545561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.545628] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.545827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.545915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.546109] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.546208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.546293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.546473] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.546560] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.546753] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.546837] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.546899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.547052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.547132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.547220] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 is going to be updated. [ 1196.556578] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1196.556789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.557412] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.557599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.557786] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.557899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.557962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.558132] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.558214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.558310] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.558431] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.559549] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.559826] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.559826] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.559955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.559955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.560071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.560138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.560230] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.570081] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.570216] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.571025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.571025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.571025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.571025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.969633] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.050498] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.062505] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.062690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.062900] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.473819] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.553283] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.553507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.553507] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.553711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.553808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.553903] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be created. [ 1197.565772] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.583388] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.583650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.583650] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.583794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.583951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.596569] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: UNINITIALIZED for 2s [ 1197.977418] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.977618] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.977723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.978053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.978166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.978307] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be updated. [ 1198.014561] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.014775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.014775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.014978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.015155] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.027753] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: IN_PROGRESS for 2s [ 1198.069626] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.069944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.070070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.070317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.070410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.070530] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1198.103964] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.104191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.104271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.104565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.105147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.115883] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1199.606730] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: SUCCESS [ 1199.607493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.607493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.607493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.607493] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.607493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.607493] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.607744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.607744] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.607809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.608627] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.037810] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1200.038131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.110988] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.111208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.111314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.111653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.111874] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.112041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.112183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.112331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.112447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.112570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.112781] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.112910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.112995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.113215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.113408] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.113538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.113625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.113814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.113923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.114068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.114196] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.130118] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1200.130469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.130722] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.131058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.131362] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.131555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.131676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.131949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.132109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.132267] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.132537] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.132711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.132827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.133060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.133302] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.133460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.133577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.133802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.133937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.134103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.134256] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.616430] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cf3edd7-c692-47b8-9058-7c2d873d8056: rpc.has_security_group_logging(os_id): False [ 1200.636428] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.636597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.636676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.636904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.637152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.637216] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.637307] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.637356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.637468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.637546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.637771] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.637891] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.638113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.638177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.638241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.638510] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.638655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.638754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.638967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.639114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.639238] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be created. [ 1200.640511] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d4e4d48-63e4-4263-8005-29e70b0f2891: rpc.has_security_group_logging(os_id): False [ 1200.663277] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.663277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.663277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.663277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.663444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.663473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.663649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.663649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.663827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.663991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.664287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.664398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.664516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.664751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.664830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.665027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.665124] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.665174] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.665325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.665401] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.665504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1200.718960] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.719163] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.719222] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.719478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.719635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.729880] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.730053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.730164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.730334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.730482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.733525] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: IN_PROGRESS for 2s [ 1200.746580] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1201.466679] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1201.466808] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1202.547407] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4f2eb03-1e68-4684-8049-57f793f7bc37 req-a745ba70-861a-4b7d-a7ab-988759164c71 tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1202.547995] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1202.548415] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.548415] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.548653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.548763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.548923] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.549120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.549120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.549248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.549331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.549427] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.738939] env[65162]: INFO networking_nsxv3.common.synchronization [req-c4f2eb03-1e68-4684-8049-57f793f7bc37 req-d4e523b7-0b0d-4249-a348-d2c257d2049a tempest-ServersTestMultiNic-1417189277 tempest-ServersTestMultiNic-1417189277-project-member] Enqueued Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1202.739675] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 with Priority: HIGHEST for action security_group_members [ 1202.740160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d4e4d48-63e4-4263-8005-29e70b0f2891 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.740296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.747116] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: SUCCESS [ 1202.747319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.761948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1202.762205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.762371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.762585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.762704] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.977582] env[65162]: INFO networking_nsxv3.common.synchronization [req-3ebe0903-6d85-4cfb-8672-57436a94e4f3 req-c80c3dac-a995-493e-be2f-9f94b065852b tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1202.978147] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGHEST for action security_group_members [ 1202.978469] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.978590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.978667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.978853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.979017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.979120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.979180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.979327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.979416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.979510] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.052373] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.286220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.286398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.286398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.286651] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.286748] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.286852] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be deleted. [ 1203.340653] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.340815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.340896] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.341114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.341207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.341321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.481541] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.481750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.481750] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.481960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.482072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.482273] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.482375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.482437] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.482583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.482659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.482744] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be updated. [ 1203.510444] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.510622] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.510660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.510874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.511019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.519959] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: IN_PROGRESS for 2s [ 1203.554575] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.057368] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.057548] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.057615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.057892] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.058059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.058178] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be updated. [ 1204.096086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.096086] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.096269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.096344] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.096542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.107087] env[65162]: INFO networking_nsxv3.common.synchronization [req-e4a40db1-77f6-4f15-bb3b-e012953c89de req-64ec35b4-4701-49e0-8765-10980cc82360 tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1204.108270] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: IN_PROGRESS for 2s [ 1204.108928] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1204.109473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.109759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.109928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.110260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.111166] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.111166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.111166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.111166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.111166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.111166] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.614290] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.614290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.614290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.614290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.614788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.614788] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.614788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.614788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.614939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.615027] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.615122] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1204.642938] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.643147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.643147] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.643360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.643503] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.652722] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1205.532383] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 in Status: SUCCESS [ 1205.532638] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 deletion is rescheduled due to dependency. [ 1205.532758] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.696864] env[65162]: INFO networking_nsxv3.common.synchronization [req-84f371de-ef68-4dfd-8078-bf231cd830b4 req-abbe3b76-ef9c-459c-89d9-fa5498e022cd tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 1205.697071] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGHEST for action security_group_members [ 1205.697249] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.697373] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.697444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.697637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.697827] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.697902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.698712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.698712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.698712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.698712] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.760882] env[65162]: INFO networking_nsxv3.common.synchronization [req-84f371de-ef68-4dfd-8078-bf231cd830b4 req-abbe3b76-ef9c-459c-89d9-fa5498e022cd tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 with Priority: HIGHEST for action port [ 1205.760882] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 with Priority: HIGHEST for action port [ 1205.761474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-39798e5b-78c7-4e8e-b304-997aec8b5b53 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.761831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.762114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.762828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.763256] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39798e5b-78c7-4e8e-b304-997aec8b5b53',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.120489] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 in Status: SUCCESS [ 1206.120707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.120888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.121271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.121483] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.121626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.121710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.121905] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.122026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.122135] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d4e4d48-63e4-4263-8005-29e70b0f2891',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.201216] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.201378] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.201450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.201659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.202638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.202638] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.202638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.202638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.202638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.202994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.202994] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be updated. [ 1206.250104] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.250322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.250416] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.250693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.250902] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.260245] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: IN_PROGRESS for 2s [ 1206.265722] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39798e5b-78c7-4e8e-b304-997aec8b5b53 with status ACTIVE [ 1206.265875] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.266034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.266110] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.266323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.266429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.266829] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.266943] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.267013] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.267182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.267263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.267448] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.267542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.267604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.267742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.267815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.267899] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39798e5b-78c7-4e8e-b304-997aec8b5b53 is going to be updated. [ 1206.294259] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.294583] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.294802] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.295227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.295447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.295664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39798e5b-78c7-4e8e-b304-997aec8b5b53" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.624541] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.626533] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.626533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.626533] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d4e4d48-63e4-4263-8005-29e70b0f2891 is going to be deleted. [ 1206.659117] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.659117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.659117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.659315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.659694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.659694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d4e4d48-63e4-4263-8005-29e70b0f2891" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.665385] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1206.665587] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 deletion is rescheduled due to dependency. [ 1206.665710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.709631] env[65162]: INFO networking_nsxv3.common.synchronization [req-9d321cab-94c6-45a0-9a39-42da840555bd req-4b00ec3e-d8c5-4aad-ad7b-0727e8932184 tempest-AttachVolumeNegativeTest-526819911 tempest-AttachVolumeNegativeTest-526819911-project-member] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_members [ 1206.710361] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGHEST for action security_group_members [ 1206.711282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.712465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.712465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.712465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.712465] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.712465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.712694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.712827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.712951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.713096] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.215693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.215918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.217104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.217343] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.217445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.217668] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.218179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.218179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.218179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.218179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.218330] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f is going to be updated. [ 1207.251227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.251551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.251551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.251841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.252125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.264080] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f in Status: IN_PROGRESS for 2s [ 1208.275695] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 in Status: SUCCESS [ 1208.276088] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 deletion is rescheduled due to dependency. [ 1208.276088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.608038] env[65162]: INFO networking_nsxv3.common.synchronization [None req-b1ca78c4-d1eb-4281-9b50-52dfb8bf7627 tempest-AttachInterfacesTestJSON-1994794978 tempest-AttachInterfacesTestJSON-1994794978-project-member] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1208.608647] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGHEST for action security_group_members [ 1208.608983] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.609117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.609182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.609558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.609558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.609709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.609858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.610692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.610692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.610692] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.112288] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.112434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.112552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.112774] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.112869] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.113085] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.113212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.113249] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.113496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.113496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.113598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be updated. [ 1209.145625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.145763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.145833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.146051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.146201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.157607] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: IN_PROGRESS for 2s [ 1209.288821] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f in Status: SUCCESS [ 1209.289210] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f deletion is rescheduled due to dependency. [ 1209.289210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.168570] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e in Status: SUCCESS [ 1211.168881] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e deletion is rescheduled due to dependency. [ 1211.168921] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.471765] env[65162]: INFO networking_nsxv3.common.synchronization [None req-739efab0-92cd-4302-9dcd-ec5724322e7b None None] Enqueued Resource ID: 59abbe48-a51d-40b3-88d2-02a8c22ad43f with Priority: HIGHEST for action port [ 1213.472164] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59abbe48-a51d-40b3-88d2-02a8c22ad43f with Priority: HIGHEST for action port [ 1213.472390] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-59abbe48-a51d-40b3-88d2-02a8c22ad43f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.473137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59abbe48-a51d-40b3-88d2-02a8c22ad43f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.473137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59abbe48-a51d-40b3-88d2-02a8c22ad43f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.473137] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59abbe48-a51d-40b3-88d2-02a8c22ad43f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.475439] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59abbe48-a51d-40b3-88d2-02a8c22ad43f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.976568] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59abbe48-a51d-40b3-88d2-02a8c22ad43f [ 1213.976831] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.976971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.977056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.977272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.977367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.977464] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59abbe48-a51d-40b3-88d2-02a8c22ad43f already deleted. [ 1213.977552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59abbe48-a51d-40b3-88d2-02a8c22ad43f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.452492] env[65162]: INFO networking_nsxv3.common.synchronization [req-490f9ab8-baeb-40b6-9c45-44e949f63c32 req-88e1f2b2-f208-4414-8019-86fb37d54de0 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1215.452898] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1215.453715] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.453868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.453935] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.454260] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.454426] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.454617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.454721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.454884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.454971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.455099] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.765044] env[65162]: INFO networking_nsxv3.common.synchronization [req-c06b9e51-343d-4793-8fda-2dc0a6897a77 req-5c8ae90d-2fa9-471d-a923-25dae330cba2 tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1215.765819] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1215.766198] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.766379] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.766494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.766731] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.766917] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.767035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.767113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.767309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.767440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.767567] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.809625] env[65162]: INFO networking_nsxv3.common.synchronization [None req-64d9200f-2530-456e-89a1-6b3c77ba4c19 None None] Enqueued Resource ID: c59b2ebd-458d-4f83-b61d-561abb3a821e with Priority: HIGHEST for action port [ 1215.809625] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b2ebd-458d-4f83-b61d-561abb3a821e with Priority: HIGHEST for action port [ 1215.809625] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-c59b2ebd-458d-4f83-b61d-561abb3a821e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.809625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c59b2ebd-458d-4f83-b61d-561abb3a821e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.809625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c59b2ebd-458d-4f83-b61d-561abb3a821e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.809625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c59b2ebd-458d-4f83-b61d-561abb3a821e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.809625] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c59b2ebd-458d-4f83-b61d-561abb3a821e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.958643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.958841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.958900] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.959143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.959246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.961411] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.961411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.961411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.961411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.961411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.961411] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1215.996353] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.996543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.996594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.996781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.996925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.016556] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1216.166261] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.166261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.166261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.166261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.166261] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.166261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.166261] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.166558] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.166602] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.166862] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.166990] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.167123] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.167310] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.167477] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.167613] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.167760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.190051] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.190722] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1216.190722] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.190722] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.191703] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-fb993810-853f-4132-8b4e-cfdc85f450df taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.191703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.191703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.191703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.191982] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb993810-853f-4132-8b4e-cfdc85f450df',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.269969] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.270212] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.270342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.270597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.270723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.270969] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.271099] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.271164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.271348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.271451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.271521] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1216.310096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.310294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.310294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.310504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.310648] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.311856] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c59b2ebd-458d-4f83-b61d-561abb3a821e [ 1216.312092] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.312181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.312248] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.312414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.312494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.312581] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c59b2ebd-458d-4f83-b61d-561abb3a821e already deleted. [ 1216.312652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c59b2ebd-458d-4f83-b61d-561abb3a821e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.326670] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1216.694814] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.694814] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.695324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.695324] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.695436] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.695520] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port fb993810-853f-4132-8b4e-cfdc85f450df not found, creating... [ 1216.695772] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.695926] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.697039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.697039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.697039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.697039] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.697039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.697039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.697421] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.697421] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.697548] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: fb993810-853f-4132-8b4e-cfdc85f450df is going to be created. [ 1216.721400] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.721616] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.721742] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.722055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.722366] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.722652] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.443764] env[65162]: INFO networking_nsxv3.common.synchronization [req-c06b9e51-343d-4793-8fda-2dc0a6897a77 req-63a436c2-d735-4e09-812e-2a79b3db0869 service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 1217.443764] env[65162]: INFO networking_nsxv3.common.synchronization [req-c06b9e51-343d-4793-8fda-2dc0a6897a77 req-63a436c2-d735-4e09-812e-2a79b3db0869 service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1217.443928] env[65162]: INFO networking_nsxv3.common.synchronization [req-c06b9e51-343d-4793-8fda-2dc0a6897a77 req-63a436c2-d735-4e09-812e-2a79b3db0869 service nova] Enqueued Resource ID: fb993810-853f-4132-8b4e-cfdc85f450df with Priority: HIGHEST for action port [ 1217.444478] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 1217.444637] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1217.444786] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb993810-853f-4132-8b4e-cfdc85f450df with Priority: HIGHEST for action port [ 1217.445152] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.445360] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.445399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.445608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.445738] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.446727] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.446827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.447041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb993810-853f-4132-8b4e-cfdc85f450df taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.447151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.447265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.447988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.447988] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb993810-853f-4132-8b4e-cfdc85f450df',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.949503] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.949992] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.949992] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb993810-853f-4132-8b4e-cfdc85f450df with status ACTIVE [ 1217.950131] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.950218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.950271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.950468] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.950570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.951269] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.951269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.951269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.951269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.951269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.951269] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.951546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.951546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.951546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.951631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.951751] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb993810-853f-4132-8b4e-cfdc85f450df is going to be updated. [ 1217.977048] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.977048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.977048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.977048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.977048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.977048] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.028373] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1218.028585] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb deletion is rescheduled due to dependency. [ 1218.028787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.337081] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1218.337275] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 deletion is rescheduled due to dependency. [ 1218.337400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.337592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.337808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.337992] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.338123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.338180] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.338338] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.338409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.338504] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.840783] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.998981] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-ddaf21e1-3ff9-47db-89c2-7a24f5be14c4 tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1218.999565] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1219.000060] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.000189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.000257] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.000514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.000691] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.000805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.000868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.001026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.001109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.001201] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.305501] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.305745] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.305880] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.306279] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.306737] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.306982] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.307163] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.307405] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.307553] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.307761] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.307876] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.308025] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.308162] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.308295] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.308458] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.308671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.331037] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.331037] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.331037] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.331037] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.331329] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-7bd5a8bb-06dc-4a27-a493-f972c68da497 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.331483] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.331661] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.332070] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.332235] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd5a8bb-06dc-4a27-a493-f972c68da497',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.344592] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.504138] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.504318] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.504376] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.504591] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.504681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.504876] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.504973] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.505051] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.505200] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.505278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.505363] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c already deleted. [ 1219.505441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.835578] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.835870] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.835964] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.836302] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.836472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.836651] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 7bd5a8bb-06dc-4a27-a493-f972c68da497 not found, creating... [ 1219.836930] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.837116] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.837247] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.837500] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.837646] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.837955] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.838135] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.838265] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.838492] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.838724] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.838879] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 7bd5a8bb-06dc-4a27-a493-f972c68da497 is going to be created. [ 1219.847179] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.847354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.847399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.847567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.847667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.847769] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1219.860753] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.860970] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.861125] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.861421] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.861749] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.861997] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.875845] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.876038] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.876089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.876306] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.876455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.887741] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1220.590759] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-bf09f460-7a81-4590-acb4-290efde74891 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1220.591051] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-bf09f460-7a81-4590-acb4-290efde74891 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1220.591133] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-bf09f460-7a81-4590-acb4-290efde74891 service nova] Enqueued Resource ID: 7bd5a8bb-06dc-4a27-a493-f972c68da497 with Priority: HIGHEST for action port [ 1220.592033] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1220.592220] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1220.592351] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd5a8bb-06dc-4a27-a493-f972c68da497 with Priority: HIGHEST for action port [ 1220.592679] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.592832] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.592996] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.593282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.593405] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.594822] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.595453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.595636] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.595864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.595864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.597045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.597045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.597045] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.597735] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd5a8bb-06dc-4a27-a493-f972c68da497 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.597858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.597924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.598105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.598187] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd5a8bb-06dc-4a27-a493-f972c68da497',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.095378] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.095606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.100504] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.102175] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bd5a8bb-06dc-4a27-a493-f972c68da497 with status ACTIVE [ 1221.102549] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.102862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.102928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.103213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.103367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.103648] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.103798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.103863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.104452] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.104640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.104965] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.105181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.105325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.105578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.105739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.105913] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bd5a8bb-06dc-4a27-a493-f972c68da497 is going to be updated. [ 1221.132711] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.132810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.132810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.133064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.133153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.133311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd5a8bb-06dc-4a27-a493-f972c68da497" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.252845] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-a5bd4cca-8900-448d-bb4d-4222d803b399 tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1221.253434] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1221.253754] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.253860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.534047] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.534047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.534047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.534047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.534047] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.534047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.534431] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.534703] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.534908] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.535166] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1221.535319] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.535460] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.535599] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.535741] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1221.535880] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.536079] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.554397] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.554561] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1221.554927] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.554927] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.555215] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-ed7b099c-d909-42c9-9761-1b0b2d330086 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.555389] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.555507] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.555821] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.555958] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7b099c-d909-42c9-9761-1b0b2d330086',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.611739] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.897332] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1221.897570] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.897712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.897972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.898274] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.898434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.898506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.898690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.898783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.898874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.898969] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.059463] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.059463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.059463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.059463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.059463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.059769] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port ed7b099c-d909-42c9-9761-1b0b2d330086 not found, creating... [ 1222.059807] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.059954] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.060094] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.060321] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.060457] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.060814] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.060979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.060979] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.061214] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.061421] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.061570] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: ed7b099c-d909-42c9-9761-1b0b2d330086 is going to be created. [ 1222.087932] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.088312] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.088527] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.088967] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.089385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.089738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.113759] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.113934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.113980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.114265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.114359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.114547] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be created. [ 1222.138350] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.138516] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.138561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.138871] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.139070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.150283] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: UNINITIALIZED for 2s [ 1222.401605] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.804623] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-976e3d02-e88a-436d-9bd2-dfae97ac16a6 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1222.805084] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-976e3d02-e88a-436d-9bd2-dfae97ac16a6 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1222.805479] env[65162]: INFO networking_nsxv3.common.synchronization [req-2258d1a7-1fe0-4fc4-8528-1206ce51fc73 req-976e3d02-e88a-436d-9bd2-dfae97ac16a6 service nova] Enqueued Resource ID: ed7b099c-d909-42c9-9761-1b0b2d330086 with Priority: HIGHEST for action port [ 1222.806621] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1222.806890] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1222.807100] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7b099c-d909-42c9-9761-1b0b2d330086 with Priority: HIGHEST for action port [ 1222.807539] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.807707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.808046] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.808211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.808894] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7b099c-d909-42c9-9761-1b0b2d330086 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.808894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.808894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.809175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.809314] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7b099c-d909-42c9-9761-1b0b2d330086',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.903831] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ef750e-5b63-4b25-85ba-13ff2b01aab2: rpc.has_security_group_logging(os_id): False [ 1222.925015] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.925197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.925272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.925495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.925594] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.925857] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.925959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.926036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.926189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.926268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.926357] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1223.000049] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.000207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.000255] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.000463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.000607] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.013853] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1223.311549] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed7b099c-d909-42c9-9761-1b0b2d330086 with status ACTIVE [ 1223.311787] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.312173] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.312273] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.312487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.312577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.312761] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.312861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.312922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.313080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.313157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.313334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.313425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.313486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.313631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.313880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.313880] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed7b099c-d909-42c9-9761-1b0b2d330086 is going to be updated. [ 1223.345904] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.345904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.346106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.346636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.346636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.346636] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7b099c-d909-42c9-9761-1b0b2d330086" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.162654] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1224.162654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.162654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.162654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.162654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.163208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.163208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.163208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.163208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.163208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.163208] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.164294] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.164537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.164643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.164815] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.164920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.165143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.165239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.165363] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.667603] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.667784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.667942] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.028312] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1225.028532] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.170708] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.675698] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.679034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.679034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.679034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.679034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.679034] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be updated. [ 1225.710502] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.710502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.710502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.710502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.710502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.724726] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1227.738335] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1227.738697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.738767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.739181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.739295] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.739364] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.739407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.739538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.739609] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.739713] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.807798] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.807960] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1228.242055] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.744340] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.248121] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.248121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.248121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.248121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.248121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.248121] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be updated. [ 1229.276967] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.277157] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.277211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.277399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.277543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.290789] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1230.475494] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f49bf11-17c4-4081-b70b-8ede28e475a5 req-6b47f84e-af84-4a18-b29c-3a0120fcc6db tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1230.476017] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1230.476340] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.476492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.476530] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.476963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.477692] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.477806] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.477877] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.478546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.478649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.478826] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.800763] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.800966] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.801119] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.801402] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.801661] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.801842] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.801982] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.802302] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.802530] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.802847] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.802995] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.803141] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.803257] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.803371] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.803476] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.803605] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.822181] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.822337] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1230.822467] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.822639] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-952" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.822978] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-ee02cf37-00d0-45a6-a660-226cfc3cdf66 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.823147] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.823276] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.823583] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.823718] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee02cf37-00d0-45a6-a660-226cfc3cdf66',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.981099] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.981327] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.981381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.981604] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.981695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.981899] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.982018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.982076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.982226] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.982302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.982390] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1231.044513] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.044721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.044721] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.044939] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.045104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.056078] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1231.300910] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1231.301145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.301269] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.301490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.301687] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.301811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.301878] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.302026] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.302117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.302203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.302359] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.302448] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.302500] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.302644] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.302780] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.302868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.302926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.303075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.303144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.303284] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.303339] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.326036] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.326285] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.326407] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.326691] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.326973] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.327125] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port ee02cf37-00d0-45a6-a660-226cfc3cdf66 not found, creating... [ 1231.327382] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.327535] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.327650] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.327867] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.329055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.329055] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.329055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.329055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.329055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.329055] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.329463] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: ee02cf37-00d0-45a6-a660-226cfc3cdf66 is going to be created. [ 1231.352276] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.352491] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.352624] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.352886] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.353181] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.353431] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.805634] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd5b2281-2ded-4f3d-8c69-ff834634648c: rpc.has_security_group_logging(os_id): False [ 1231.826828] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.826828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.826828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.826828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.827153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.827153] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.827254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.827254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.827382] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.827460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.827656] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.827752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.827814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.827955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.828050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.828227] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.828375] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.828445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.828585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.828659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.828748] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be created. [ 1231.889243] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.889435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.889525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.889824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.890059] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.902115] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1232.080895] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f49bf11-17c4-4081-b70b-8ede28e475a5 req-3fef48d1-3f6b-4d66-a2d9-8104eada8de5 service nova] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 1232.080895] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f49bf11-17c4-4081-b70b-8ede28e475a5 req-3fef48d1-3f6b-4d66-a2d9-8104eada8de5 service nova] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1232.081308] env[65162]: INFO networking_nsxv3.common.synchronization [req-7f49bf11-17c4-4081-b70b-8ede28e475a5 req-3fef48d1-3f6b-4d66-a2d9-8104eada8de5 service nova] Enqueued Resource ID: ee02cf37-00d0-45a6-a660-226cfc3cdf66 with Priority: HIGHEST for action port [ 1232.082052] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_rules [ 1232.082290] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1232.082326] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee02cf37-00d0-45a6-a660-226cfc3cdf66 with Priority: HIGHEST for action port [ 1232.083143] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.083143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.083143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.083143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.083450] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.084649] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.084825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.086562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee02cf37-00d0-45a6-a660-226cfc3cdf66 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.086562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.086562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.086562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.086562] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee02cf37-00d0-45a6-a660-226cfc3cdf66',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.587839] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.587962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.588173] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee02cf37-00d0-45a6-a660-226cfc3cdf66 with status ACTIVE [ 1232.588318] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.588423] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.588489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.588694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.588834] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.588999] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.589106] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.589166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.589315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.589391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.589565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.589654] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.589741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.589855] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.589948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.590048] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee02cf37-00d0-45a6-a660-226cfc3cdf66 is going to be updated. [ 1232.612319] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.612630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.612705] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.612912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.613067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.613234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee02cf37-00d0-45a6-a660-226cfc3cdf66" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.652467] env[65162]: INFO networking_nsxv3.common.synchronization [req-42e95dd4-1aae-4af1-a404-c3ed298ee90a req-8c314183-d221-46d4-9b98-525d7e2ba143 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1232.652992] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1232.653306] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.653430] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.653492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.653681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.653827] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.653925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.653987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.654278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.654372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.654475] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.809694] env[65162]: INFO networking_nsxv3.common.synchronization [req-76b3a477-d20e-42d0-9250-a01fdd2399e0 req-0e09cc06-0160-43e0-ab1b-fdada525b266 tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1232.810277] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1232.810592] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.810714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.810778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.810975] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.811548] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.811691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.811760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.811928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.812032] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.812133] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.009711] env[65162]: INFO networking_nsxv3.common.synchronization [req-26d9d86d-6039-412a-bd6c-baec49293be1 req-5d43ea9f-b07c-4246-9e5c-690453bd873d tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1233.010315] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1233.010679] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.010769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.042304] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.042618] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.042817] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.043549] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.043761] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.043996] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.044209] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.044538] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.044769] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.045096] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.045278] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.045410] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.045532] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.045702] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.045890] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.046129] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.066491] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1233.066692] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb deletion is rescheduled due to dependency. [ 1233.066831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.066994] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.067268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.067563] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.067714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.067786] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.067965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.068068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.068172] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.070624] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.070792] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1233.070992] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.071132] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-83" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.071455] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.071659] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.071785] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.072123] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.072290] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53b1d9f4-acd9-4327-84f0-5cf67ed5ee58',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.156526] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.314213] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.570379] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.574154] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.575484] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.575719] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.576047] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.576213] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.576372] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 not found, creating... [ 1233.576645] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.576821] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.576938] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.577180] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.577313] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.577599] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.577750] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.577863] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.578073] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.578205] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.578341] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 is going to be created. [ 1233.602346] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.602506] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.602576] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.602849] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.603091] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.603316] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.658794] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.816833] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.916863] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1233.917901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.918131] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.918358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.918455] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.075601] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.160785] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.160977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.160977] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.161297] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.161388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.161490] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1234.191409] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.191598] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.191661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.191823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.192011] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.200868] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1234.321971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.321971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.321971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.321971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.321971] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.321971] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be updated. [ 1234.327889] env[65162]: INFO networking_nsxv3.common.synchronization [req-42e95dd4-1aae-4af1-a404-c3ed298ee90a req-9743644e-9387-482e-96fe-2c2f0df4625c service nova] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 1234.328083] env[65162]: INFO networking_nsxv3.common.synchronization [req-42e95dd4-1aae-4af1-a404-c3ed298ee90a req-9743644e-9387-482e-96fe-2c2f0df4625c service nova] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1234.328219] env[65162]: INFO networking_nsxv3.common.synchronization [req-42e95dd4-1aae-4af1-a404-c3ed298ee90a req-9743644e-9387-482e-96fe-2c2f0df4625c service nova] Enqueued Resource ID: 53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 with Priority: HIGHEST for action port [ 1234.328453] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_rules [ 1234.328583] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1234.328680] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 with Priority: HIGHEST for action port [ 1234.329275] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.329400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.329508] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.329663] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.329746] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.331361] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.331600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.331832] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.331978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.332034] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.332189] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.332270] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53b1d9f4-acd9-4327-84f0-5cf67ed5ee58',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.351223] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.351392] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.351435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.351631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.351775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.360587] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1234.441219] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.441450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.441450] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.441626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.441717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.441819] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be deleted. [ 1234.492422] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.492652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.492652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.492850] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.492955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.493095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.577067] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.577243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.577351] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.577522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.577610] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.577710] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1234.616282] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.616426] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.616498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.616704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.616849] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.628653] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1234.832639] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.832997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.834598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 with status ACTIVE [ 1234.834904] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.835021] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.835182] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.835353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.835465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.835689] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.835783] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.835852] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.836114] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.836252] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.836458] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.836588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.836646] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.836766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.836838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.836926] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53b1d9f4-acd9-4327-84f0-5cf67ed5ee58 is going to be updated. [ 1234.859457] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.859629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.859629] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.859821] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.860041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.860203] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53b1d9f4-acd9-4327-84f0-5cf67ed5ee58" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.581506] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.582020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.582020] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.582586] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.582858] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.583033] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.583155] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.583367] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.583509] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.583764] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1235.583838] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.583925] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.584043] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.584148] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1235.584251] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.584381] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.602832] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.602997] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1235.603145] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.603321] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-328" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.603625] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-e0d3d9ce-b80f-4495-9be8-e3763d50525c taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.603795] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.603916] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.604178] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.604314] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d3d9ce-b80f-4495-9be8-e3763d50525c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.106705] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.107270] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.107270] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.107389] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.107529] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.107800] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.107965] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.108097] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.108313] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.108447] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.108756] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.108964] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.109065] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.109277] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.109415] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.109577] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c is going to be updated. [ 1236.135645] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.135921] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.136098] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.136425] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.136635] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.136915] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.214903] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 4s [ 1236.372546] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1236.372546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.372546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.372546] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.372882] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.372882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.372882] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.373100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.373100] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.373100] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.638313] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1236.638567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.638757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.639055] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.639292] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.639387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.639445] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.639652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.639753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.639887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.640016] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.829184] env[65162]: INFO networking_nsxv3.common.synchronization [req-41913d6c-86df-4129-aef0-80ac5d3b2bce req-0be65a8f-143d-49e8-b3b0-a405167fed77 service nova] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1236.829383] env[65162]: INFO networking_nsxv3.common.synchronization [req-41913d6c-86df-4129-aef0-80ac5d3b2bce req-0be65a8f-143d-49e8-b3b0-a405167fed77 service nova] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1236.829523] env[65162]: INFO networking_nsxv3.common.synchronization [req-41913d6c-86df-4129-aef0-80ac5d3b2bce req-0be65a8f-143d-49e8-b3b0-a405167fed77 service nova] Enqueued Resource ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c with Priority: HIGHEST for action port [ 1236.830125] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_rules [ 1236.830261] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1236.830358] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c with Priority: HIGHEST for action port [ 1236.830643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.830753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.830816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.831018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.831107] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.831942] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.832217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.832217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.832358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.832427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.832518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.832578] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.832724] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.833311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.833311] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.834211] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0d3d9ce-b80f-4495-9be8-e3763d50525c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.834211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.834211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.834211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.834211] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d3d9ce-b80f-4495-9be8-e3763d50525c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.875674] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.875887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.875887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.876214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.876316] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.876544] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.876738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.876793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.876993] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.877123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.877234] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be deleted. [ 1236.910784] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.910951] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.910997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.911276] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.911367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.911467] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.142740] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.335425] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.335669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.335844] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.336779] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0d3d9ce-b80f-4495-9be8-e3763d50525c with status ACTIVE [ 1237.337279] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.337279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.337279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.337535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.337535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.337608] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.337702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.337853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.337910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.337983] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.338647] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.338647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.338647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.338647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.338647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.338647] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0d3d9ce-b80f-4495-9be8-e3763d50525c is going to be updated. [ 1237.362051] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.362302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.362302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.362551] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.362695] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.362853] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0d3d9ce-b80f-4495-9be8-e3763d50525c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.645401] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a02c478-9c75-420c-a387-bc52bfa702cb: rpc.has_security_group_logging(os_id): False [ 1237.664242] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.664469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.664576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.664795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.664889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.665174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.665279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.665346] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.665498] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.665576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.665666] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1237.732154] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.732396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.732396] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.732707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.732846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.745885] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1237.840658] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.226518] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1238.226839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.226901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.227168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.227371] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.227510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.227580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.227698] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.227776] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.227875] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.343598] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.343864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.343864] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.344062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.344161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.344279] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 is going to be updated. [ 1238.378276] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.378577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.378577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.378727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.378841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.389315] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: IN_PROGRESS for 2s [ 1238.730330] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.233016] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.735886] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.735886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.735886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.736209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.736209] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.736336] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1239.760124] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1239.760356] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.770603] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.770785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.770831] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.771047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.771223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.780407] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1240.401033] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: SUCCESS [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.401033] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.401033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.401843] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.904264] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.406948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 055c27af-8eff-41f6-aced-6244f2d29090: rpc.has_security_group_logging(os_id): False [ 1241.425640] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.425808] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.425885] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.426126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.426218] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.426558] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.426694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.426823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.427096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.427096] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.427201] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 is going to be updated. [ 1241.495244] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.495404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.495457] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.495701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.495874] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.510251] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: IN_PROGRESS for 2s [ 1241.792392] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1241.792713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.792936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.793176] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.793391] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.793525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.793600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.793810] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.793899] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.794035] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.794132] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.830968] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.831170] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1242.296969] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.799345] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e983155-2c0f-440c-885b-2648c7ee2a33: rpc.has_security_group_logging(os_id): False [ 1242.817831] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.817968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.818060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.818309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.818404] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.818644] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.818751] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.818814] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.818972] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.819129] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.819166] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1242.882012] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.882231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.882272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.882522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.882687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.900453] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1243.524541] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: SUCCESS [ 1243.524868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.803496] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-d8e3f421-7182-4fc9-8fd6-3f38fe985ea4 tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1244.804235] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1244.804611] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.804792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.804964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.805181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.805405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.805600] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.805732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.806429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.806429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.806429] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.916738] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1244.917107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.144377] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.144590] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.144631] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.144938] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.145211] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.145489] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.145647] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.145877] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.146804] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.146804] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.146804] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.146804] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.146804] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.146804] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.146804] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.147237] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.166473] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.166678] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1245.166760] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.166968] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.167320] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.167601] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.167730] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.168069] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.168211] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.308906] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.309179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.309179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.309407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.309497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.309694] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.309792] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.309857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.310115] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.310208] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.310298] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c already deleted. [ 1245.310380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.671488] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.671798] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.671798] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.672145] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.672407] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.672590] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 not found, creating... [ 1245.672868] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.673039] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.673158] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.673482] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.673663] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.674027] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.674270] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.674500] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.674781] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.674857] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.675011] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 is going to be created. [ 1245.696150] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.696436] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.696675] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.697052] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.697388] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.697686] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.440056] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-5f9456e5-0d0c-43ef-8ec7-5d3e167ec057 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1246.440997] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-5f9456e5-0d0c-43ef-8ec7-5d3e167ec057 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1246.440997] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-5f9456e5-0d0c-43ef-8ec7-5d3e167ec057 service nova] Enqueued Resource ID: fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 with Priority: HIGHEST for action port [ 1246.441235] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1246.441392] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1246.441485] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 with Priority: HIGHEST for action port [ 1246.441827] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.441980] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.442095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.443142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.443142] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.443425] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.443562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.443762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.443842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.444012] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.444158] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.444245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.444413] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.444543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.444650] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.445576] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.445701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.445771] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.445957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.446065] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.948407] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.948543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.948739] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.951467] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 with status ACTIVE [ 1246.951670] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.951793] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.951862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.952087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.952191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.952355] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.952443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.952506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.952657] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.952733] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.952909] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.952995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.953070] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.953204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.953278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.953361] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8 is going to be updated. [ 1246.975485] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.975700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.975700] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.976095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.976095] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.976756] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe1db537-c8aa-4a3f-ad85-48cf0dd5beb8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.017905] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-5425efad-565e-4c91-a9c4-d76da72454d3 tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1247.018541] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1247.021199] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.021199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.341506] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.342709] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.342911] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.343255] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.343608] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.343839] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.344034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.344297] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.344498] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.344792] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.344970] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.345144] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.345298] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.345542] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.345612] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.345787] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.363083] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.363311] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1247.363488] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.363698] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-823" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.364221] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-2a77a587-154d-4e07-b35e-ae8570010063 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.364221] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.364338] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.364872] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.365031] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a77a587-154d-4e07-b35e-ae8570010063',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.450934] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.867075] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.867309] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.867449] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.867738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.867885] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.868055] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Segment Port 2a77a587-154d-4e07-b35e-ae8570010063 not found, creating... [ 1247.868320] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.868473] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.868588] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.868803] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.868959] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.869264] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.869422] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.869537] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.869738] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.869871] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.870055] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: 2a77a587-154d-4e07-b35e-ae8570010063 is going to be created. [ 1247.893323] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.893571] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.893640] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.893918] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.894254] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.894387] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.953372] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.953617] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.953704] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.953968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.954074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.954220] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be created. [ 1248.003748] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.004029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.004194] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.004568] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.004847] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.016194] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: UNINITIALIZED for 2s [ 1248.639931] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-1352684c-d2b1-4bf4-ab21-6c77ae516a94 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1248.640204] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-1352684c-d2b1-4bf4-ab21-6c77ae516a94 service nova] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1248.640204] env[65162]: INFO networking_nsxv3.common.synchronization [req-b5ccc754-ddcf-425d-ba4b-c46da39f8e83 req-1352684c-d2b1-4bf4-ab21-6c77ae516a94 service nova] Enqueued Resource ID: 2a77a587-154d-4e07-b35e-ae8570010063 with Priority: HIGHEST for action port [ 1248.640689] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_rules [ 1248.640826] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1248.640926] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a77a587-154d-4e07-b35e-ae8570010063 with Priority: HIGHEST for action port [ 1248.642037] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.642153] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.642370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.642454] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.642640] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a77a587-154d-4e07-b35e-ae8570010063 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.642759] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.642813] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.643063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.643213] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a77a587-154d-4e07-b35e-ae8570010063',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.145445] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a77a587-154d-4e07-b35e-ae8570010063 with status ACTIVE [ 1249.145684] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.145824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.145894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.146225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.146371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.146567] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.146672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.146735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.146954] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.147060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.147286] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.147443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.147480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.147606] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.147681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.147766] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a77a587-154d-4e07-b35e-ae8570010063 is going to be updated. [ 1249.169971] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.170210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.170263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.170573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.170718] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.170879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a77a587-154d-4e07-b35e-ae8570010063" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.027598] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1250.028047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.028141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.028368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.028564] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.028680] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.028739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.028895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.029047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.029152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.029254] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.030288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.030484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.030686] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.030800] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.030865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.031066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.031122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.031207] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.533370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.533585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.533703] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.037072] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.539384] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.539616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.539673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.539987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.540130] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.540219] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be updated. [ 1251.569699] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.569925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.569925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.570141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.570309] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.580182] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1253.592134] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1253.592527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.592527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.592746] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.592904] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.593046] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.593122] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.593237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.593336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.593431] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.641734] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.641989] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1254.095481] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.599878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.102389] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.102599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.102639] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.102858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.102944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.103057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be updated. [ 1255.135578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.135789] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.135844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.136047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.136223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.147097] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1257.158186] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1257.158534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.158575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.158762] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.158946] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.159105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.159172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.159330] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.159433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.159525] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.159679] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.159777] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.159838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.159976] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.160126] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.160245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.160311] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.160414] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.160486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.160565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.160653] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.663058] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd5b2281-2ded-4f3d-8c69-ff834634648c: rpc.has_security_group_logging(os_id): False [ 1257.690982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.690982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.690982] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.690982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.691938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.691938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.691938] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.691938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.691938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.691938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.691938] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.691938] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be created. [ 1257.777973] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.778287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.778287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.779673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.779673] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.798773] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1258.643216] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1258.643661] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1258.952947] env[65162]: INFO networking_nsxv3.common.synchronization [req-37cd1217-f86d-4a78-9a34-2cb8ba05a4c3 req-71a58802-65d7-407b-869f-aa48d27b3710 tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1258.953939] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1258.954334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.954465] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.954534] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.954740] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.954902] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.955015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.955082] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.955229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.955326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.955414] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.003805] env[65162]: INFO networking_nsxv3.common.synchronization [req-6da3e2d7-dcde-4e63-ab6f-af6ba96b193b req-5832bffa-80c9-4770-a920-fb7119d18fdc tempest-MultipleCreateTestJSON-310799601 tempest-MultipleCreateTestJSON-310799601-project-member] Enqueued Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1259.004628] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b2281-2ded-4f3d-8c69-ff834634648c with Priority: HIGHEST for action security_group_members [ 1259.005027] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5b2281-2ded-4f3d-8c69-ff834634648c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.005319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.457757] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.813569] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1259.813965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.813965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.814184] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.814273] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.960443] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.334951] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.335165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.335165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.335321] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.335418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.335513] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be deleted. [ 1260.386385] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.386720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.386720] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.386863] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.386936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.387075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.463864] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.464078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.464078] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.464324] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.464385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.464456] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be updated. [ 1260.500415] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.500608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.500608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.500787] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.500910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.510378] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: IN_PROGRESS for 2s [ 1262.521417] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5b2281-2ded-4f3d-8c69-ff834634648c in Status: SUCCESS [ 1262.521818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.521818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.521995] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.522194] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.522308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.522372] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.522519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.522599] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.522693] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5b2281-2ded-4f3d-8c69-ff834634648c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.024668] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.024860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.024860] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.025120] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.025215] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.025398] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.025597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.025597] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.025732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.025809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.025897] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5b2281-2ded-4f3d-8c69-ff834634648c is going to be deleted. [ 1263.052349] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.052521] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.052566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.052755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.052846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.052944] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5b2281-2ded-4f3d-8c69-ff834634648c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.005702] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.006148] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.898351] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1265.898638] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:3 started [ 1269.007190] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.007648] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.008501] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.008879] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1279.009092] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.009442] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1284.010013] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.010308] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.508903] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.509279] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.509352] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.509682] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.510022] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.510224] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.510379] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.510591] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.510734] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.511015] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1287.511247] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1287.511314] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1287.511453] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1287.511596] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1287.511754] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1287.511918] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1287.531628] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1287.531809] env[65162]: DEBUG dogpile.cache.region [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1287.531946] env[65162]: DEBUG dogpile.lock [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1287.532188] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "network-697" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.532496] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock port-fb993810-853f-4132-8b4e-cfdc85f450df taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.532667] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.532784] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.533043] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.533181] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb993810-853f-4132-8b4e-cfdc85f450df',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.036325] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.036325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.036325] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.036545] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.036694] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.036972] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.037138] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.037251] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.037503] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.037629] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.037921] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.038118] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.038234] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.038435] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.038568] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.038704] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Resource: SegmentPort with ID: fb993810-853f-4132-8b4e-cfdc85f450df is going to be updated. [ 1288.061921] env[65162]: DEBUG networking_nsxv3.common.locking [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.062236] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.062419] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.062749] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.062957] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.063250] env[65162]: DEBUG oslo_concurrency.lockutils [None req-e3508eea-820c-4b0a-8268-464c17cdece4 None None] Releasing lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.749828] env[65162]: INFO networking_nsxv3.common.synchronization [req-042de789-f8c0-4273-94c7-af64531cb3b6 req-6c406ad9-ccd8-4ec8-b5e5-5a8d8193b577 service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 1288.750189] env[65162]: INFO networking_nsxv3.common.synchronization [req-042de789-f8c0-4273-94c7-af64531cb3b6 req-6c406ad9-ccd8-4ec8-b5e5-5a8d8193b577 service nova] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1288.750189] env[65162]: INFO networking_nsxv3.common.synchronization [req-042de789-f8c0-4273-94c7-af64531cb3b6 req-6c406ad9-ccd8-4ec8-b5e5-5a8d8193b577 service nova] Enqueued Resource ID: fb993810-853f-4132-8b4e-cfdc85f450df with Priority: HIGHEST for action port [ 1288.750773] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_rules [ 1288.751065] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1288.751065] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb993810-853f-4132-8b4e-cfdc85f450df with Priority: HIGHEST for action port [ 1288.751316] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.751474] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.751576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.751781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.751878] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.752836] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.752957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.753030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.753225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.753437] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.753511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.753626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.753742] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.753830] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.753924] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.755308] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb993810-853f-4132-8b4e-cfdc85f450df taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.755308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.755308] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.755543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.755543] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb993810-853f-4132-8b4e-cfdc85f450df',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.257609] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.258787] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.259225] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.259225] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb993810-853f-4132-8b4e-cfdc85f450df with status ACTIVE [ 1289.259225] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.259470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.259470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.259669] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.260565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.260565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.260565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.260565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.260565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.260565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.260565] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.260876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.260876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.260876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.260957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.260957] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb993810-853f-4132-8b4e-cfdc85f450df is going to be updated. [ 1289.282171] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.282429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.282429] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.282566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.282703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.282865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb993810-853f-4132-8b4e-cfdc85f450df" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.763032] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.265316] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.265542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.265593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.265856] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.265958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.266076] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1290.298693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.298978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.298978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.299211] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.299381] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.308609] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1291.306577] env[65162]: INFO networking_nsxv3.common.synchronization [req-dec0c914-9a96-448f-97dc-9109f275a1cc req-13c262ea-e659-48e3-8cfa-a6246679f840 tempest-AttachVolumeShelveTestJSON-1413670911 tempest-AttachVolumeShelveTestJSON-1413670911-project-member] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1291.307526] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGHEST for action security_group_members [ 1291.307977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.308161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.308261] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.308533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.308743] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.308880] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.308997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.309206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.309334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.309476] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.812493] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.812723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.812723] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.812931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.813041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.813234] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.813337] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.813399] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.813547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.813624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.813711] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 is going to be updated. [ 1291.841782] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.842036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.842036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.842246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.842433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.853307] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: IN_PROGRESS for 2s [ 1292.320808] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1292.321143] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.321336] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.321590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.321816] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.321963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.322068] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.322258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.322419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.322470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.322573] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.824791] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.328103] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ef750e-5b63-4b25-85ba-13ff2b01aab2: rpc.has_security_group_logging(os_id): False [ 1293.346159] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.347590] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.347686] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.347979] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.348145] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.348436] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.348557] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.348665] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.348906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.349071] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.349199] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1293.412698] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.412898] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.412978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.413213] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.413391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.428083] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1293.865499] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 055c27af-8eff-41f6-aced-6244f2d29090 in Status: SUCCESS [ 1293.865707] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 deletion is rescheduled due to dependency. [ 1293.865822] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.443795] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1295.444234] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.846302] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.846539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.846539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.847175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.847175] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.308298] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.308415] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.349200] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.851624] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.354345] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1297.354582] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1297.692745] env[65162]: INFO networking_nsxv3.common.synchronization [req-6b791908-1a8a-4812-a619-27f7b10c9c5d req-7e9c44db-9667-41e8-96a1-74434992ffc7 tempest-ServerActionsTestJSON-1959502156 tempest-ServerActionsTestJSON-1959502156-project-member] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1297.693626] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGHEST for action security_group_members [ 1297.693940] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.694077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.694144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.694341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.694492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.694596] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.694655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.694803] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.694906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.695015] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.198782] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.198782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.198782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.198782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.198782] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.199422] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.199422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.199422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.199422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.199422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.199673] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be updated. [ 1298.216236] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.216446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.216496] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.216703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.228920] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1298.230029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.231534] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1298.238757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.238937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.239042] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.239272] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.239411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.247733] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: IN_PROGRESS for 2s [ 1298.272741] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.272989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.272989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.273197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.285561] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.286476] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1298.286624] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1298.286683] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1298.337707] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.337707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.337707] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.338539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.339240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.339502] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1298.432957] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.433183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.433183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.433400] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.433727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.434040] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1298.508777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.509028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.509028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.509906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.509906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.510073] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1298.510073] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'055c27af-8eff-41f6-aced-6244f2d29090', '1a02c478-9c75-420c-a387-bc52bfa702cb', 'a0866c18-786e-4157-b82e-c968cd3e4da4', '98741f74-4767-46bd-99a2-76cd0a555e4d', '90d61f12-2370-49b2-b09d-04dcee0f59d7', '05f11b06-d4ac-4526-b2b0-8dcd11c88e34', '3f63f6a1-b8e9-46e1-b655-55fea2b21f7f', 'a7fd6bec-6820-40d4-9564-ee5cb9c2521e', '2cf3edd7-c692-47b8-9058-7c2d873d8056', '2e983155-2c0f-440c-885b-2648c7ee2a33', '845a1349-3919-404b-9935-ad355e3ebd5b', '542ab4ea-1934-47eb-b35d-a11a9e723c30', 'f2880f64-bee4-45fb-88ef-a60ad0c676d2', 'b55eb5d3-a252-4f36-9046-1505d8f8fa4e', '8402ae4d-ae29-4339-9c47-47671f8a297d', '61d6cfb7-70e3-40e9-910e-91206aa6d806', '03c457f4-5193-48c8-99b4-9dd3e8a1a23d', '47ef750e-5b63-4b25-85ba-13ff2b01aab2', '56db26ed-c49a-44f4-95c8-7daf9b19435e', 'd8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c', '9750e22b-5fab-447f-83f8-693fd5c74e09', 'f86c44d7-d532-4841-9243-c4031dd1f02d', '669aed0f-0b7f-4e96-9c95-c67fdbc3580b', '9998726b-c2cc-495a-9b94-43b9da32545d', '7f84ca5c-ce92-4db5-9d7f-838f30c85f1f', 'f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5', 'dda58912-2918-4cc8-9735-fc69849b0476', '523df74a-7dca-4c8d-a869-891ca0abbe71', '3335dfc0-bd35-4429-ae08-fe5e4847acff', '7caef476-012f-4313-ac05-e9388bfdc717', '9277ea7b-0e9f-4304-afc4-0c02fdc31f78', 'd813c855-9a5b-4789-b322-fc73fc195c5d', '19a33b05-c764-41fc-b486-255a775ecff1', 'cc14b794-c440-4406-844c-ac39d23312a4', '1a35add5-dafe-4fde-989e-70f334050fa8', 'be9d78f4-56f5-4314-9b4c-a33024af1fa8', '8aa618a0-b9c1-4139-a8f5-7f536dba7d9a', 'dd94e034-7289-4a18-8431-d4bba42b0823', 'a29ad06f-d3bc-443d-9727-1f7cc59ff50a', '7b521adf-a3c4-47a4-a31d-e406ca77ccb7', 'c05adefa-98e3-4c1c-adb3-589d73d33b2f', '2f904e96-f18d-4ef1-be07-0c2f77a78a73', 'a8d82595-19fb-4678-9933-9ad14fdf5ab6', '76494ce4-3ed0-426c-ac36-271f9eef282c', '884160b0-aa09-4db4-aad6-b412d510fa72', 'ec0acf84-468d-4a9a-80be-4595d495629a'} {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1298.510220] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1298.530873] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.531103] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.531148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.531395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.531504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.531623] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1298.531703] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1298.531778] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1298.615258] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.615490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.615490] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.615732] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.617015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.617301] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1298.617374] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1298.617464] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1298.617537] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1298.617599] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1298.617648] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGH for action security_group_rules [ 1298.617710] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGH for action security_group_rules [ 1298.617782] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGH for action security_group_rules [ 1298.617857] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGH for action security_group_rules [ 1298.617939] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGH for action security_group_rules [ 1298.618141] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGH for action security_group_rules [ 1298.618141] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGH for action security_group_rules [ 1298.618141] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGH for action security_group_rules [ 1298.618341] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGH for action security_group_rules [ 1298.618341] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGH for action security_group_rules [ 1298.618341] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGH for action security_group_rules [ 1298.618483] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGH for action security_group_rules [ 1298.618483] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGH for action security_group_rules [ 1298.618577] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGH for action security_group_rules [ 1298.618577] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGH for action security_group_rules [ 1298.618680] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGH for action security_group_rules [ 1298.618680] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGH for action security_group_rules [ 1298.618781] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGH for action security_group_rules [ 1298.618816] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGH for action security_group_rules [ 1298.618851] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGH for action security_group_rules [ 1298.618949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.258766] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a02c478-9c75-420c-a387-bc52bfa702cb in Status: SUCCESS [ 1300.259190] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb deletion is rescheduled due to dependency. [ 1300.259190] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c27af-8eff-41f6-aced-6244f2d29090 with Priority: HIGH for action security_group_rules [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0866c18-786e-4157-b82e-c968cd3e4da4 with Priority: HIGH for action security_group_rules [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f with Priority: HIGH for action security_group_rules [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8402ae4d-ae29-4339-9c47-47671f8a297d with Priority: HIGH for action security_group_rules [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c with Priority: HIGH for action security_group_rules [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e with Priority: HIGH for action security_group_rules [ 1302.695881] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845a1349-3919-404b-9935-ad355e3ebd5b with Priority: HIGH for action security_group_rules [ 1302.696463] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGH for action security_group_rules [ 1302.696707] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 with Priority: HIGH for action security_group_rules [ 1302.696707] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 with Priority: HIGH for action security_group_rules [ 1302.696707] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e with Priority: HIGH for action security_group_rules [ 1302.696793] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 with Priority: HIGH for action security_group_rules [ 1302.696847] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a02c478-9c75-420c-a387-bc52bfa702cb with Priority: HIGH for action security_group_rules [ 1302.697257] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98741f74-4767-46bd-99a2-76cd0a555e4d with Priority: HIGH for action security_group_rules [ 1302.697617] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-055c27af-8eff-41f6-aced-6244f2d29090 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.697752] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.697818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.698348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.698489] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('055c27af-8eff-41f6-aced-6244f2d29090',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.699443] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0866c18-786e-4157-b82e-c968cd3e4da4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.699625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.699739] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.699953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.700078] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0866c18-786e-4157-b82e-c968cd3e4da4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.700897] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.703538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.703538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.703538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.703538] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f63f6a1-b8e9-46e1-b655-55fea2b21f7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.703538] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8402ae4d-ae29-4339-9c47-47671f8a297d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.703538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.703538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.703538] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.703538] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8402ae4d-ae29-4339-9c47-47671f8a297d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.704872] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.705172] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.705275] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.705464] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.705567] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.706611] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56db26ed-c49a-44f4-95c8-7daf9b19435e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.706611] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.706918] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.707186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.707347] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56db26ed-c49a-44f4-95c8-7daf9b19435e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.708094] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.708459] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.710685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.710685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.710685] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.710685] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.710685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.710685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.710685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.710685] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03c457f4-5193-48c8-99b4-9dd3e8a1a23d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.710685] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.711183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.711183] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.711264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.711366] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55eb5d3-a252-4f36-9046-1505d8f8fa4e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.712085] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61d6cfb7-70e3-40e9-910e-91206aa6d806 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.712304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.712407] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.712613] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.712783] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61d6cfb7-70e3-40e9-910e-91206aa6d806',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.713578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.713757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.713807] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.714281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.715022] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2880f64-bee4-45fb-88ef-a60ad0c676d2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.715719] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-542ab4ea-1934-47eb-b35d-a11a9e723c30 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.716302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.716302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.716302] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.716302] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('542ab4ea-1934-47eb-b35d-a11a9e723c30',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.717252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845a1349-3919-404b-9935-ad355e3ebd5b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.717616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.717616] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.718142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.718142] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845a1349-3919-404b-9935-ad355e3ebd5b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.719505] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.719819] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.720358] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.720653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.720653] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.723879] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf3edd7-c692-47b8-9058-7c2d873d8056 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.723997] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.724075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.724278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.724399] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf3edd7-c692-47b8-9058-7c2d873d8056',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.725223] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.725735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.725735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.725735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.725735] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05f11b06-d4ac-4526-b2b0-8dcd11c88e34',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.729100] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.729543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.730627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.730627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.730627] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fd6bec-6820-40d4-9564-ee5cb9c2521e',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.731484] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90d61f12-2370-49b2-b09d-04dcee0f59d7 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.731484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.731484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.731484] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.731667] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90d61f12-2370-49b2-b09d-04dcee0f59d7',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.732357] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a02c478-9c75-420c-a387-bc52bfa702cb taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.732357] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.732483] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.732522] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.732593] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a02c478-9c75-420c-a387-bc52bfa702cb',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.733342] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98741f74-4767-46bd-99a2-76cd0a555e4d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.733502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.733502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.733642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.733711] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98741f74-4767-46bd-99a2-76cd0a555e4d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.764500] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.764653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.764696] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.764928] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.795196] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.795361] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 055c27af-8eff-41f6-aced-6244f2d29090 is going to be deleted. [ 1302.854474] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.854619] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.854709] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.854904] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.854991] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.855123] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-055c27af-8eff-41f6-aced-6244f2d29090" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.253220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.253432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.253432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.253699] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.253908] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.254052] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.254144] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.254325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.254444] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.254566] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.254725] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.258687] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.258687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.258687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.258929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.259088] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.259217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.259303] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.259487] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.259638] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.259767] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.259881] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.266142] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.266289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.266393] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.266647] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.296995] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.297244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.338270] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.338433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.339439] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.339565] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.340362] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.340502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.341238] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.341380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.342237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.342389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.343160] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.343329] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.344147] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.344325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.345237] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.345371] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.346104] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.346244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.347112] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.347639] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.347838] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.348576] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.349042] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.349223] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.350050] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.350529] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.350692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.351335] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.351925] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.352100] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05f11b06-d4ac-4526-b2b0-8dcd11c88e34 is going to be deleted. [ 1303.353033] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.353286] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.355310] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.355453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.356244] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.356389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.357029] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.357465] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.357626] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.376284] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.376881] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.377090] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0866c18-786e-4157-b82e-c968cd3e4da4 is going to be deleted. [ 1303.378036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.378304] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.406028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.406028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f63f6a1-b8e9-46e1-b655-55fea2b21f7f is going to be deleted. [ 1303.406028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.406028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.415811] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.415990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.423919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.424080] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8402ae4d-ae29-4339-9c47-47671f8a297d is going to be deleted. [ 1303.424967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.425970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.445119] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.445283] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.449017] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.449017] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a02c478-9c75-420c-a387-bc52bfa702cb is going to be deleted. [ 1303.449241] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.449455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.472072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.472072] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56db26ed-c49a-44f4-95c8-7daf9b19435e is going to be deleted. [ 1303.472317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.472543] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.474185] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.474325] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.515878] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.516113] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.517186] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.517356] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90d61f12-2370-49b2-b09d-04dcee0f59d7 is going to be deleted. [ 1303.518290] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.518541] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.637529] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.637729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.638672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.638832] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf3edd7-c692-47b8-9058-7c2d873d8056 is going to be deleted. [ 1303.639886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.640148] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.656223] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.656471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.663839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.663987] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55eb5d3-a252-4f36-9046-1505d8f8fa4e is going to be deleted. [ 1303.664981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.665245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.692772] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.692772] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fd6bec-6820-40d4-9564-ee5cb9c2521e is going to be deleted. [ 1303.693734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.693960] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.719175] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.719580] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.736489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.736489] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03c457f4-5193-48c8-99b4-9dd3e8a1a23d is going to be deleted. [ 1303.737890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.738166] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.764405] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.773863] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.775991] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.776140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.807959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.808462] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61d6cfb7-70e3-40e9-910e-91206aa6d806 is going to be deleted. [ 1303.810057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.810057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.815073] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.815245] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.851443] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.851443] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.861505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.861505] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2880f64-bee4-45fb-88ef-a60ad0c676d2 is going to be deleted. [ 1303.862725] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.863424] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.893612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.893766] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c is going to be deleted. [ 1303.894848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.894959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.921720] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.922020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.940167] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.940319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.977701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.977803] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98741f74-4767-46bd-99a2-76cd0a555e4d is going to be deleted. [ 1303.978816] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.979060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.009174] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.009263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.035062] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.035213] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 542ab4ea-1934-47eb-b35d-a11a9e723c30 is going to be deleted. [ 1304.036506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.036506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.038911] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.039069] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.069025] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.069025] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845a1349-3919-404b-9935-ad355e3ebd5b is going to be deleted. [ 1304.069910] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.070154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.070319] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.070394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05f11b06-d4ac-4526-b2b0-8dcd11c88e34" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.070640] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.070812] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.070894] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.071029] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0866c18-786e-4157-b82e-c968cd3e4da4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.071552] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.071693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.071879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.071879] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f63f6a1-b8e9-46e1-b655-55fea2b21f7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.072031] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.072178] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.072253] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.072366] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8402ae4d-ae29-4339-9c47-47671f8a297d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.072495] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.072635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.072712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.072825] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a02c478-9c75-420c-a387-bc52bfa702cb" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.072964] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.073125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.073202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.073312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56db26ed-c49a-44f4-95c8-7daf9b19435e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.073441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.073576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.073653] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.073795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90d61f12-2370-49b2-b09d-04dcee0f59d7" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.073924] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.074080] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.074162] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.074254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55eb5d3-a252-4f36-9046-1505d8f8fa4e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.074377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.074514] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.074588] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.074697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf3edd7-c692-47b8-9058-7c2d873d8056" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.074818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.074950] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.075041] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.075151] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fd6bec-6820-40d4-9564-ee5cb9c2521e" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.075277] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.075411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.075482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.075593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03c457f4-5193-48c8-99b4-9dd3e8a1a23d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.075713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.075846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.075914] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.076036] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61d6cfb7-70e3-40e9-910e-91206aa6d806" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.076161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.076295] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.076370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.076478] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2880f64-bee4-45fb-88ef-a60ad0c676d2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.076766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.076934] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.077019] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.077202] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8dbce39-78f0-4e9e-a4eb-2f8abb9eaa8c" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.137643] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.137868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.137915] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.138142] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.138240] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.138436] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98741f74-4767-46bd-99a2-76cd0a555e4d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.152464] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.152664] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.152702] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.152888] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.152982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.153121] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-542ab4ea-1934-47eb-b35d-a11a9e723c30" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.213453] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.214173] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.214461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.215072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.215072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.215072] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.215239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845a1349-3919-404b-9935-ad355e3ebd5b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.266700] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ef750e-5b63-4b25-85ba-13ff2b01aab2: rpc.has_security_group_logging(os_id): False [ 1304.275868] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e983155-2c0f-440c-885b-2648c7ee2a33: rpc.has_security_group_logging(os_id): False [ 1304.301364] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.301571] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.301630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.301862] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.303562] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.303674] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.348224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.348601] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.348745] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.348805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.348988] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.349094] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.349209] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1304.350735] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.351185] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.389353] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.389755] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.390111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.390111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.390206] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.390271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.390332] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1304.471885] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.472058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.472107] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.472312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.472461] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.489028] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1304.498784] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.498926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.498926] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.499152] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.499299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.514043] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1305.088612] env[65162]: INFO networking_nsxv3.common.synchronization [req-6da57f1a-0892-4b48-ad15-5252575a6216 req-416c04e9-bcff-40c9-8139-4f30edeb2357 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1305.089149] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1305.089443] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.089584] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.089643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.090244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.090244] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.090398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.090471] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.090931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.090931] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.090931] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.593621] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.095577] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.503960] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1306.504210] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.526069] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1306.526593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.599011] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.599236] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.599312] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.599527] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.599666] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.599768] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1306.617980] env[65162]: INFO networking_nsxv3.common.synchronization [None req-97a6b00e-5df3-4ab4-afdb-72daf8072db1 None None] Enqueued Resource ID: 9e06fa3c-0570-4889-a9d6-cd655d875e94 with Priority: HIGHEST for action port [ 1306.618534] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e06fa3c-0570-4889-a9d6-cd655d875e94 with Priority: HIGHEST for action port [ 1306.618838] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e06fa3c-0570-4889-a9d6-cd655d875e94 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.618963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e06fa3c-0570-4889-a9d6-cd655d875e94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.619089] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e06fa3c-0570-4889-a9d6-cd655d875e94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.619279] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e06fa3c-0570-4889-a9d6-cd655d875e94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.619360] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e06fa3c-0570-4889-a9d6-cd655d875e94',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.629629] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.629857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.629857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.630074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.630258] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.640349] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1307.120256] env[65162]: INFO networking_nsxv3.common.synchronization [req-f7002931-d29b-42f9-9fcf-005407272313 req-f45c9f03-62cb-46b3-abf0-b484bdb04bde tempest-ServerActionsTestOtherB-1088051914 tempest-ServerActionsTestOtherB-1088051914-project-member] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1307.120810] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGHEST for action security_group_members [ 1307.121084] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e06fa3c-0570-4889-a9d6-cd655d875e94 [ 1307.121280] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.121395] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.121463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.121685] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.121741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.121836] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e06fa3c-0570-4889-a9d6-cd655d875e94 already deleted. [ 1307.121908] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e06fa3c-0570-4889-a9d6-cd655d875e94" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.122122] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.122224] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.122282] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.122428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.122560] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.122652] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.122714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.122846] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.122922] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.123014] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.625779] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.625779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.625779] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.625963] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.626729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.626729] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.626729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.626729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.626729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.626729] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.626729] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be updated. [ 1307.657672] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.657823] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.657949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.658214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.658389] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.667375] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: IN_PROGRESS for 2s [ 1308.649426] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1308.649795] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.677865] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 in Status: SUCCESS [ 1309.678281] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 deletion is rescheduled due to dependency. [ 1309.678281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.353177] env[65162]: INFO networking_nsxv3.common.synchronization [None req-55aa8499-3e70-476d-bdfb-d223f34b695a None None] Enqueued Resource ID: 2b9276cf-336a-4a90-be9b-30a6b7897a73 with Priority: HIGHEST for action port [ 1310.353430] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9276cf-336a-4a90-be9b-30a6b7897a73 with Priority: HIGHEST for action port [ 1310.353977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9276cf-336a-4a90-be9b-30a6b7897a73 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.354092] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9276cf-336a-4a90-be9b-30a6b7897a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.354161] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9276cf-336a-4a90-be9b-30a6b7897a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.354409] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9276cf-336a-4a90-be9b-30a6b7897a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.354489] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9276cf-336a-4a90-be9b-30a6b7897a73',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.857342] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b9276cf-336a-4a90-be9b-30a6b7897a73 [ 1310.857342] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.857342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.857342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.857342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.857342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.857342] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b9276cf-336a-4a90-be9b-30a6b7897a73 already deleted. [ 1310.857342] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9276cf-336a-4a90-be9b-30a6b7897a73" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.014035] env[65162]: INFO networking_nsxv3.common.synchronization [None req-245597e2-0524-4440-b98d-ad82d084d314 tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_rules [ 1311.014035] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_rules [ 1311.014427] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.014427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.014427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.014575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.014658] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.098056] env[65162]: INFO networking_nsxv3.common.synchronization [None req-58182201-b524-4407-9dbe-dd5a04b7524b tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_rules [ 1311.098674] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_rules [ 1311.098988] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.099204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.536422] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.536575] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.536692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.536859] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.536911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.537015] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f already deleted. [ 1311.537109] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.537262] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.537411] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.537495] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.057775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.058128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.058128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.058128] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.058243] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.058327] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f already deleted. [ 1312.058367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.494694] env[65162]: INFO networking_nsxv3.common.synchronization [None req-274a8ff6-4820-430d-96a4-3ebb0bedb497 None None] Enqueued Resource ID: 78553ed5-1e54-4bf1-96fc-611ac50c1e44 with Priority: HIGHEST for action port [ 1312.494941] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78553ed5-1e54-4bf1-96fc-611ac50c1e44 with Priority: HIGHEST for action port [ 1312.495532] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-78553ed5-1e54-4bf1-96fc-611ac50c1e44 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.495713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78553ed5-1e54-4bf1-96fc-611ac50c1e44" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.495713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78553ed5-1e54-4bf1-96fc-611ac50c1e44" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.496040] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78553ed5-1e54-4bf1-96fc-611ac50c1e44" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.496040] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78553ed5-1e54-4bf1-96fc-611ac50c1e44',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.998766] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78553ed5-1e54-4bf1-96fc-611ac50c1e44 [ 1312.998766] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.998766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.998766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.998766] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.999093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.999093] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78553ed5-1e54-4bf1-96fc-611ac50c1e44 already deleted. [ 1312.999093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78553ed5-1e54-4bf1-96fc-611ac50c1e44" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.496143] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.496468] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.704690] env[65162]: INFO networking_nsxv3.common.synchronization [req-9176baac-f37b-4bad-b57c-c4bf430a9c57 req-8835760d-a2c8-433f-b5f9-6ee8eb88c11d tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_members [ 1317.705222] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_members [ 1317.705529] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.705668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.705765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.705959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.706301] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.706410] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.706469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.706625] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.706713] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.706812] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.077950] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.078565] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.078939] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.079512] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.080083] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.080366] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.080497] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.080899] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.081121] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.081349] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1318.081506] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1318.081571] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1318.081671] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1318.081777] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1318.081880] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1318.082041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1318.112573] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1318.112778] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1318.112871] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1318.113193] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.113556] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-5596d269-4156-4564-8c39-1c4e41d1f828 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.113968] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.114126] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.114467] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.114609] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5596d269-4156-4564-8c39-1c4e41d1f828',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.209997] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.210201] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.210278] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.210506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.210608] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.210868] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.210984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.211064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.211244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.211341] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.211453] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f already deleted. [ 1318.211540] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.617319] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.617732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.617732] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.618178] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.618330] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.618556] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 5596d269-4156-4564-8c39-1c4e41d1f828 not found, creating... [ 1318.618915] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.619118] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.619252] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.619472] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.619611] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.619955] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.620125] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.620239] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.620436] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.620565] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.620708] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 5596d269-4156-4564-8c39-1c4e41d1f828 is going to be created. [ 1318.642546] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.642803] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.642862] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.643158] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.643389] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.643620] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.354741] env[65162]: INFO networking_nsxv3.common.synchronization [req-9176baac-f37b-4bad-b57c-c4bf430a9c57 req-2d44818e-4c33-4a15-a9ae-7d482f717ea7 service nova] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_rules [ 1319.354741] env[65162]: INFO networking_nsxv3.common.synchronization [req-9176baac-f37b-4bad-b57c-c4bf430a9c57 req-2d44818e-4c33-4a15-a9ae-7d482f717ea7 service nova] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_members [ 1319.354741] env[65162]: INFO networking_nsxv3.common.synchronization [req-9176baac-f37b-4bad-b57c-c4bf430a9c57 req-2d44818e-4c33-4a15-a9ae-7d482f717ea7 service nova] Enqueued Resource ID: 5596d269-4156-4564-8c39-1c4e41d1f828 with Priority: HIGHEST for action port [ 1319.355222] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_rules [ 1319.355357] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_members [ 1319.355451] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5596d269-4156-4564-8c39-1c4e41d1f828 with Priority: HIGHEST for action port [ 1319.355726] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.355884] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.355961] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.356497] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.356585] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.357542] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.357727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.357843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.358177] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.358717] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.358717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.358717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.358936] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.359081] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.359193] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.360096] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-5596d269-4156-4564-8c39-1c4e41d1f828 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.360246] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.360348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.360670] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.360670] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5596d269-4156-4564-8c39-1c4e41d1f828',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.862811] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.864260] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.864370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.864524] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5596d269-4156-4564-8c39-1c4e41d1f828 with status ACTIVE [ 1319.864710] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.864857] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.864968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.865112] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.865187] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.865348] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.865441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.865486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.865643] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.865715] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.865893] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.865981] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.866090] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.866191] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.866263] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.866345] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5596d269-4156-4564-8c39-1c4e41d1f828 is going to be updated. [ 1319.888706] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.888919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.888919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.889728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.889728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.889728] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5596d269-4156-4564-8c39-1c4e41d1f828" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.368262] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.622370] env[65162]: INFO networking_nsxv3.common.synchronization [req-c02fe8f9-c676-4727-b862-7ff5bb2b6ec6 req-2eafc7ca-2010-4047-9aea-fa80095e8ef9 tempest-ServerActionsTestOtherA-998927199 tempest-ServerActionsTestOtherA-998927199-project-member] Enqueued Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1320.622898] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 with Priority: HIGHEST for action security_group_members [ 1320.623214] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e983155-2c0f-440c-885b-2648c7ee2a33 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.623333] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.623397] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.623587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.623739] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.623835] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.623895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.624047] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.624133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.624227] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e983155-2c0f-440c-885b-2648c7ee2a33',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.871925] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.872359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.872359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.872439] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.872518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.872756] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f is going to be created. [ 1320.930271] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.930512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.930512] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.930675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.930844] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.941144] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1d86cc-d114-49ae-882e-c23ec021c65f in Status: UNINITIALIZED for 2s [ 1321.127038] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.127231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.127231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.127377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.127470] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.127667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.127839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.127839] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.127984] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.128050] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.128194] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 is going to be updated. [ 1321.155977] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.156204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.156270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.156562] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.156754] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.165602] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: IN_PROGRESS for 2s [ 1322.951948] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1d86cc-d114-49ae-882e-c23ec021c65f in Status: SUCCESS [ 1322.951948] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.952494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.952494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.952603] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.952661] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.952694] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.952840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.952923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.953045] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.953108] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.175260] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 in Status: SUCCESS [ 1323.175453] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e983155-2c0f-440c-885b-2648c7ee2a33 deletion is rescheduled due to dependency. [ 1323.175581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e983155-2c0f-440c-885b-2648c7ee2a33" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.456024] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.958219] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce1d86cc-d114-49ae-882e-c23ec021c65f: rpc.has_security_group_logging(os_id): False [ 1323.978020] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.978271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.978383] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.978612] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.978741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.979053] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.979197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.979274] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.979451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.979509] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.979640] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f is going to be created. [ 1324.046287] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.046585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.046585] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.046757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.046965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.060092] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce1d86cc-d114-49ae-882e-c23ec021c65f in Status: IN_PROGRESS for 2s [ 1325.623875] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.623875] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1326.085233] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce1d86cc-d114-49ae-882e-c23ec021c65f in Status: SUCCESS [ 1326.085511] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.624640] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.624640] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.625398] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.625834] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.626416] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.626814] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.627962] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.628338] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.628967] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.628967] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.629601] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.630075] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.631302] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.631686] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.632427] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.632427] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.633101] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.633521] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.634289] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.634659] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.635378] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.635824] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.636937] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.637346] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.637911] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.638299] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.638820] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.639239] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.640643] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.640643] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.642105] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.642105] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.643422] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.643926] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.644465] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.644465] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.645830] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.645830] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.646682] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.647098] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.647632] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.648077] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.648761] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.649230] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.650352] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.650770] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.651701] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.652233] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.653221] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.653676] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.654890] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.654890] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.655663] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.655663] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.994908] env[65162]: INFO networking_nsxv3.common.synchronization [req-61d78d5b-f722-4950-8b2d-1d8f02f5de82 req-c0cada57-10f3-49a0-83dd-7d4cd5e0f87d tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_members [ 1461.995454] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGHEST for action security_group_members [ 1461.995777] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.995906] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.995970] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.996181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.996334] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.996427] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.996486] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.996655] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.996703] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.997011] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.499770] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.499770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.499770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.499770] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.500134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.500134] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.500134] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.500264] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.500419] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.500537] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.500668] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f is going to be updated. [ 1462.543452] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.543682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.543682] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.543851] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.543989] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.552955] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1d86cc-d114-49ae-882e-c23ec021c65f in Status: IN_PROGRESS for 2s [ 1464.565061] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce1d86cc-d114-49ae-882e-c23ec021c65f in Status: SUCCESS [ 1464.565547] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f deletion is rescheduled due to dependency. [ 1464.565547] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.574424] env[65162]: INFO networking_nsxv3.common.synchronization [None req-2a82dcfb-ae6d-4608-a4f9-233af3847668 tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_rules [ 1466.575221] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_rules [ 1466.575522] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.575641] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.575701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.575953] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.576049] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.650518] env[65162]: INFO networking_nsxv3.common.synchronization [None req-5126fac7-3b77-4b76-9a86-62fa1354d6aa tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_rules [ 1466.651022] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_rules [ 1466.651372] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.651499] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.096649] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.096794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.096861] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.097101] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.097198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.097295] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 already deleted. [ 1467.097380] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.097519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.097734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.097825] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.616693] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.617075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.617075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.617254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.617254] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.617358] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 already deleted. [ 1467.617435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.652076] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.652443] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.534249] env[65162]: INFO networking_nsxv3.common.synchronization [req-2dfb66c7-8ece-43e2-bbec-539e98033a3d req-69dffe89-1afd-4075-82bd-9685888d564e tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_members [ 1472.534305] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_members [ 1472.534605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.534734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.534798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.535063] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.535224] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.535332] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.535391] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.535544] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.535805] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.535805] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.821579] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.821579] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.822134] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.822134] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.822134] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.822462] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.822462] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.822655] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.822765] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.822973] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1472.823097] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] NeedRegenerationException {{(pid=65162) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1472.823240] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] no value, waiting for create lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1472.823310] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] value creation lock acquired {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1472.823404] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] No value present for key: 'zone-id' {{(pid=65162) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1472.823571] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Calling creation function for not-yet-present value {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1472.823671] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1472.843346] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1472.843536] env[65162]: DEBUG dogpile.cache.region [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65162) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1472.843627] env[65162]: DEBUG dogpile.lock [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Released creation lock {{(pid=65162) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1472.843821] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "network-63" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.844118] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock port-0e8fb819-326c-4695-9e78-ee9510ad8c7f taken with stack trace [, , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.844288] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.844407] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.844710] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.844852] env[65162]: DEBUG networking_nsxv3.api.rpc [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8fb819-326c-4695-9e78-ee9510ad8c7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.038145] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.038385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.038385] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.038576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.038668] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.038861] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.038958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.039030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.039247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.039322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.039402] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 already deleted. [ 1473.039482] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.347661] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.347873] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.348014] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.348307] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.348460] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.348610] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Segment Port 0e8fb819-326c-4695-9e78-ee9510ad8c7f not found, creating... [ 1473.348865] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.349034] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.349155] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.349385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.349526] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.349799] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.349961] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.350072] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.350274] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.350406] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.350540] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Resource: SegmentPort with ID: 0e8fb819-326c-4695-9e78-ee9510ad8c7f is going to be created. [ 1473.370187] env[65162]: DEBUG networking_nsxv3.common.locking [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.370385] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.370463] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.370717] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.370943] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.371188] env[65162]: DEBUG oslo_concurrency.lockutils [None req-19c94676-31ef-45f6-9009-656ea8fd2682 None None] Releasing lock "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.064691] env[65162]: INFO networking_nsxv3.common.synchronization [req-2dfb66c7-8ece-43e2-bbec-539e98033a3d req-07347de5-ac68-46ca-b0c8-4243da5f512f service nova] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_rules [ 1474.065047] env[65162]: INFO networking_nsxv3.common.synchronization [req-2dfb66c7-8ece-43e2-bbec-539e98033a3d req-07347de5-ac68-46ca-b0c8-4243da5f512f service nova] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_members [ 1474.065047] env[65162]: INFO networking_nsxv3.common.synchronization [req-2dfb66c7-8ece-43e2-bbec-539e98033a3d req-07347de5-ac68-46ca-b0c8-4243da5f512f service nova] Enqueued Resource ID: 0e8fb819-326c-4695-9e78-ee9510ad8c7f with Priority: HIGHEST for action port [ 1474.065483] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_rules [ 1474.065639] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_members [ 1474.065704] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e8fb819-326c-4695-9e78-ee9510ad8c7f with Priority: HIGHEST for action port [ 1474.066074] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.066217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.066217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.066340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.066428] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.068573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.068573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.068573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.068573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.068573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.068573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.068573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.068875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.068875] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.068875] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.069556] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e8fb819-326c-4695-9e78-ee9510ad8c7f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.069717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.069717] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.070440] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.070440] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8fb819-326c-4695-9e78-ee9510ad8c7f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.571775] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.571775] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.571897] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.572818] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e8fb819-326c-4695-9e78-ee9510ad8c7f with status ACTIVE [ 1474.573013] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.573140] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.573204] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.574077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.574077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.574077] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.574077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.574077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.574077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.574077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.574460] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.574460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.574460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.574649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.574649] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.574649] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e8fb819-326c-4695-9e78-ee9510ad8c7f is going to be updated. [ 1474.596667] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.596886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.596886] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.597088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.597238] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.597398] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e8fb819-326c-4695-9e78-ee9510ad8c7f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.076713] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.580057] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.580057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.580057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.580057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.580057] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.580057] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 is going to be created. [ 1475.602207] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.602442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.602442] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.602660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.602833] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.612760] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: UNINITIALIZED for 2s [ 1477.623477] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: SUCCESS [ 1477.623840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.623840] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.624058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.624252] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.624368] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.624435] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.624586] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.624667] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.624753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.624844] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.126828] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.629684] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 350c3e5b-5953-4a2c-bcae-93550de23d21: rpc.has_security_group_logging(os_id): False [ 1478.647338] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.647624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.647624] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.647765] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.647843] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.648094] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.648192] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.648247] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.648405] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.648485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.648573] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 is going to be created. [ 1478.721877] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.722133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.722133] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.722348] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.722492] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.733027] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: IN_PROGRESS for 2s [ 1479.066643] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.066867] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1480.746727] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: SUCCESS [ 1480.747108] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.068285] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.068667] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.070178] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.070602] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.071900] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.072343] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.074528] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.074528] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.075824] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.076285] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.899807] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1505.899807] env[65162]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ae62ddc1-c6a4-4503-9390-ec88ab77c2ac None None] NSXv3 Agent Agent loop - iteration:4 started [ 1509.077059] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.077433] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.078416] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.078908] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.079687] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.079995] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.081508] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.082027] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.082574] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.082854] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.083620] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.083950] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.850017] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.850451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.850451] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.850550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.850630] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.353404] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.857164] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.359735] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1537.359923] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1538.126166] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.126659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.126659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.126659] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.278149] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1538.279018] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.280279] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1538.319217] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.319418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.319418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.319632] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.331967] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.332749] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1538.332839] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1538.332952] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1538.364130] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.364370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.364370] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.364506] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.365231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.365377] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1538.443101] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.443359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.443359] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.443463] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.443784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.444221] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1538.521405] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.521627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.521627] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.521854] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.522181] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.522469] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 1538.522565] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'350c3e5b-5953-4a2c-bcae-93550de23d21', '47ef750e-5b63-4b25-85ba-13ff2b01aab2', '9750e22b-5fab-447f-83f8-693fd5c74e09', 'f86c44d7-d532-4841-9243-c4031dd1f02d', '669aed0f-0b7f-4e96-9c95-c67fdbc3580b', 'ce1d86cc-d114-49ae-882e-c23ec021c65f', '9998726b-c2cc-495a-9b94-43b9da32545d', '7f84ca5c-ce92-4db5-9d7f-838f30c85f1f', 'f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5', 'dda58912-2918-4cc8-9735-fc69849b0476', '523df74a-7dca-4c8d-a869-891ca0abbe71', '3335dfc0-bd35-4429-ae08-fe5e4847acff', '7caef476-012f-4313-ac05-e9388bfdc717', '9277ea7b-0e9f-4304-afc4-0c02fdc31f78', 'd813c855-9a5b-4789-b322-fc73fc195c5d', '19a33b05-c764-41fc-b486-255a775ecff1', 'cc14b794-c440-4406-844c-ac39d23312a4', '1a35add5-dafe-4fde-989e-70f334050fa8', 'be9d78f4-56f5-4314-9b4c-a33024af1fa8', '8aa618a0-b9c1-4139-a8f5-7f536dba7d9a', 'dd94e034-7289-4a18-8431-d4bba42b0823', 'a29ad06f-d3bc-443d-9727-1f7cc59ff50a', '7b521adf-a3c4-47a4-a31d-e406ca77ccb7', 'c05adefa-98e3-4c1c-adb3-589d73d33b2f', '2e983155-2c0f-440c-885b-2648c7ee2a33', '2f904e96-f18d-4ef1-be07-0c2f77a78a73', 'a8d82595-19fb-4678-9933-9ad14fdf5ab6', '76494ce4-3ed0-426c-ac36-271f9eef282c', '884160b0-aa09-4db4-aad6-b412d510fa72', 'ec0acf84-468d-4a9a-80be-4595d495629a'} {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1538.522683] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1538.541301] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.541510] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.541592] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.541824] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.541917] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.542041] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1538.542115] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1538.542185] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1538.616975] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.617214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.617214] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.617402] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.618533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.618777] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1538.618855] env[65162]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65162) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1538.618926] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1538.618994] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1538.619090] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 1538.619161] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGH for action security_group_rules [ 1538.619239] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGH for action security_group_rules [ 1538.619303] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGH for action security_group_rules [ 1538.619364] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGH for action security_group_rules [ 1538.619425] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGH for action security_group_rules [ 1538.619486] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGH for action security_group_rules [ 1538.619547] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGH for action security_group_rules [ 1538.619608] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGH for action security_group_rules [ 1538.619666] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGH for action security_group_rules [ 1538.619725] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGH for action security_group_rules [ 1538.619809] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGH for action security_group_rules [ 1538.619890] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGH for action security_group_rules [ 1538.619952] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGH for action security_group_rules [ 1538.620020] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGH for action security_group_rules [ 1538.620084] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGH for action security_group_rules [ 1538.620145] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGH for action security_group_rules [ 1538.620205] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGH for action security_group_rules [ 1538.620265] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGH for action security_group_rules [ 1538.620326] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGH for action security_group_rules [ 1538.620387] env[65162]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGH for action security_group_rules [ 1538.620480] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.085356] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.085552] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1539.085601] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGH for action security_group_rules [ 1539.085709] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 with Priority: HIGH for action security_group_rules [ 1539.085836] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9998726b-c2cc-495a-9b94-43b9da32545d with Priority: HIGH for action security_group_rules [ 1539.085925] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d813c855-9a5b-4789-b322-fc73fc195c5d with Priority: HIGH for action security_group_rules [ 1539.086033] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a with Priority: HIGH for action security_group_rules [ 1539.086128] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 with Priority: HIGH for action security_group_rules [ 1539.086216] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a35add5-dafe-4fde-989e-70f334050fa8 with Priority: HIGH for action security_group_rules [ 1539.086304] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14b794-c440-4406-844c-ac39d23312a4 with Priority: HIGH for action security_group_rules [ 1539.086412] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 with Priority: HIGH for action security_group_rules [ 1539.086480] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a33b05-c764-41fc-b486-255a775ecff1 with Priority: HIGH for action security_group_rules [ 1539.086556] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caef476-012f-4313-ac05-e9388bfdc717 with Priority: HIGH for action security_group_rules [ 1539.086644] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff with Priority: HIGH for action security_group_rules [ 1539.086732] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 with Priority: HIGH for action security_group_rules [ 1539.086818] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda58912-2918-4cc8-9735-fc69849b0476 with Priority: HIGH for action security_group_rules [ 1539.086916] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 with Priority: HIGH for action security_group_rules [ 1539.087053] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1d86cc-d114-49ae-882e-c23ec021c65f with Priority: HIGH for action security_group_rules [ 1539.087160] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f with Priority: HIGH for action security_group_rules [ 1539.087252] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b with Priority: HIGH for action security_group_rules [ 1539.087338] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 with Priority: HIGH for action security_group_rules [ 1539.087426] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86c44d7-d532-4841-9243-c4031dd1f02d with Priority: HIGH for action security_group_rules [ 1539.087758] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.087887] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.087955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.088229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.088317] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.089494] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9750e22b-5fab-447f-83f8-693fd5c74e09 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.089494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.089494] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.089738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.089738] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9750e22b-5fab-447f-83f8-693fd5c74e09',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.090946] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9998726b-c2cc-495a-9b94-43b9da32545d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.091066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.091066] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.091195] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.091268] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9998726b-c2cc-495a-9b94-43b9da32545d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.091955] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d813c855-9a5b-4789-b322-fc73fc195c5d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.092077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.092125] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.092268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.092338] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d813c855-9a5b-4789-b322-fc73fc195c5d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.093288] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.093288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.093288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.093288] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.093467] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8aa618a0-b9c1-4139-a8f5-7f536dba7d9a',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.094119] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.094660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.094660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.094660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.094660] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9d78f4-56f5-4314-9b4c-a33024af1fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.095148] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a35add5-dafe-4fde-989e-70f334050fa8 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.095340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.095340] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.095545] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.095545] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a35add5-dafe-4fde-989e-70f334050fa8',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.096169] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc14b794-c440-4406-844c-ac39d23312a4 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.096289] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.096331] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.096778] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.096778] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc14b794-c440-4406-844c-ac39d23312a4',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.097279] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.097394] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.097455] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.097587] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.097659] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9277ea7b-0e9f-4304-afc4-0c02fdc31f78',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.098314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a33b05-c764-41fc-b486-255a775ecff1 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.098422] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.098485] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.098631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.098704] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a33b05-c764-41fc-b486-255a775ecff1',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.099370] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caef476-012f-4313-ac05-e9388bfdc717 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.099472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.099542] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.099681] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.099742] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caef476-012f-4313-ac05-e9388bfdc717',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.100519] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3335dfc0-bd35-4429-ae08-fe5e4847acff taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.100631] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.100692] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.100841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.100915] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3335dfc0-bd35-4429-ae08-fe5e4847acff',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.101573] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-523df74a-7dca-4c8d-a869-891ca0abbe71 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.101675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.101734] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.101912] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.101987] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('523df74a-7dca-4c8d-a869-891ca0abbe71',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.102680] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dda58912-2918-4cc8-9735-fc69849b0476 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.102796] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.102858] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.103023] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.103092] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dda58912-2918-4cc8-9735-fc69849b0476',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.103737] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.103841] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.103911] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.104064] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.104230] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.104895] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce1d86cc-d114-49ae-882e-c23ec021c65f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.105015] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.105091] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.105232] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.105305] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce1d86cc-d114-49ae-882e-c23ec021c65f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.105945] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.106073] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.106141] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.106291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.106400] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f84ca5c-ce92-4db5-9d7f-838f30c85f1f',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.107041] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.107164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.107217] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.107314] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.107387] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('669aed0f-0b7f-4e96-9c95-c67fdbc3580b',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.108151] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.108271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.108363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.108441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.108512] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ef750e-5b63-4b25-85ba-13ff2b01aab2',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.109181] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f86c44d7-d532-4841-9243-c4031dd1f02d taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.109293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.109363] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.109469] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.109538] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f86c44d7-d532-4841-9243-c4031dd1f02d',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.136492] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.136798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.136798] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.136890] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.139607] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.139753] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.140441] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.140536] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.157075] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.157209] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9750e22b-5fab-447f-83f8-693fd5c74e09 is going to be deleted. [ 1539.158058] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.158265] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.175087] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.175220] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8aa618a0-b9c1-4139-a8f5-7f536dba7d9a is going to be deleted. [ 1539.176323] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.176519] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.194462] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.194585] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d813c855-9a5b-4789-b322-fc73fc195c5d is going to be deleted. [ 1539.222654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.222868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.222868] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.223074] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.223169] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.223287] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9750e22b-5fab-447f-83f8-693fd5c74e09" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.226046] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.226164] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.226231] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.226406] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.226489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.226602] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8aa618a0-b9c1-4139-a8f5-7f536dba7d9a" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.245796] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.245962] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.246024] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.246270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.246377] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.246418] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d813c855-9a5b-4789-b322-fc73fc195c5d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.623611] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.623828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.623828] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.624053] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.624220] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.624322] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.624387] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.624535] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.624621] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.624710] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.624805] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.684528] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.684781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.684781] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.684959] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.686834] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.686968] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.687817] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.687817] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.688552] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.688675] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.689314] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.689408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.690144] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.690237] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.690923] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.691030] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.691712] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.691848] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.692546] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.692642] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.693379] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.693472] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.694172] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.694271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.695536] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1539.696114] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.696239] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.697022] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1539.697352] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.697460] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.698180] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1539.698605] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.698714] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.699342] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1539.699825] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.699937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.700638] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1539.701086] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.701198] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.711448] env[65162]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1539.711955] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.712107] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f84ca5c-ce92-4db5-9d7f-838f30c85f1f is going to be deleted. [ 1539.713093] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.713301] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.730326] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.730522] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dda58912-2918-4cc8-9735-fc69849b0476 is going to be deleted. [ 1539.731291] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.731501] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.749453] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.749657] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f86c44d7-d532-4841-9243-c4031dd1f02d is going to be deleted. [ 1539.750447] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.750660] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.771895] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.772117] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a35add5-dafe-4fde-989e-70f334050fa8 is going to be deleted. [ 1539.772919] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.773138] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.795325] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.795555] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.801732] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.801923] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.802578] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.802687] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.809630] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.809763] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9d78f4-56f5-4314-9b4c-a33024af1fa8 is going to be deleted. [ 1539.810633] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.810842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.834691] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.834873] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9277ea7b-0e9f-4304-afc4-0c02fdc31f78 is going to be deleted. [ 1539.835866] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.836117] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.854650] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.854842] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.872446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.872605] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3335dfc0-bd35-4429-ae08-fe5e4847acff is going to be deleted. [ 1539.873533] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.873755] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.896024] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.896227] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.915126] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.915302] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc14b794-c440-4406-844c-ac39d23312a4 is going to be deleted. [ 1539.916199] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.916425] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.956346] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.956567] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.973635] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.973817] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9998726b-c2cc-495a-9b94-43b9da32545d is going to be deleted. [ 1539.974697] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.974929] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.025456] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.025690] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.074712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.074949] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 523df74a-7dca-4c8d-a869-891ca0abbe71 is going to be deleted. [ 1540.076205] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.076446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.105167] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.105388] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.132179] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.132359] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ef750e-5b63-4b25-85ba-13ff2b01aab2 is going to be deleted. [ 1540.133299] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.133518] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.135809] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.160757] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.160757] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.165020] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.165168] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5 is going to be deleted. [ 1540.166077] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.166293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.203058] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.203270] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.225539] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.225791] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce1d86cc-d114-49ae-882e-c23ec021c65f is going to be deleted. [ 1540.226576] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.226794] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.270785] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.271039] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caef476-012f-4313-ac05-e9388bfdc717 is going to be deleted. [ 1540.271982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.272244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.320428] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.320428] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.321334] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.321460] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 669aed0f-0b7f-4e96-9c95-c67fdbc3580b is going to be deleted. [ 1540.322504] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.322711] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.367062] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.367315] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.374847] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.375088] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.378933] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.379122] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a33b05-c764-41fc-b486-255a775ecff1 is going to be deleted. [ 1540.380060] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.380281] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.380408] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.380529] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dda58912-2918-4cc8-9735-fc69849b0476" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.380769] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.380965] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.381056] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.381175] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f86c44d7-d532-4841-9243-c4031dd1f02d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.381741] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.381958] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.382067] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.382207] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f84ca5c-ce92-4db5-9d7f-838f30c85f1f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.382354] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.382502] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.382581] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.382693] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a35add5-dafe-4fde-989e-70f334050fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.382818] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.382957] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.383049] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.383165] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9d78f4-56f5-4314-9b4c-a33024af1fa8" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.383296] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.383432] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.383505] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.383615] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9277ea7b-0e9f-4304-afc4-0c02fdc31f78" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.383738] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.383876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.383949] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.384079] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3335dfc0-bd35-4429-ae08-fe5e4847acff" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.384244] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.384433] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.384524] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.384637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc14b794-c440-4406-844c-ac39d23312a4" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.384763] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.384903] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.384978] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.385104] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9998726b-c2cc-495a-9b94-43b9da32545d" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.385229] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.385367] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.385441] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.385550] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-523df74a-7dca-4c8d-a869-891ca0abbe71" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.385676] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.385809] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.385883] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.385990] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ef750e-5b63-4b25-85ba-13ff2b01aab2" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.386135] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.386271] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.386345] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.386456] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7d9c0fd-909e-49fc-bdd9-aeb2e7f85fd5" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.386577] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.386712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.386784] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.386889] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce1d86cc-d114-49ae-882e-c23ec021c65f" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.441274] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.441489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.441489] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.441672] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.441760] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.441937] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caef476-012f-4313-ac05-e9388bfdc717" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.481654] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.481920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.481920] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.482105] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.482197] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.482317] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-669aed0f-0b7f-4e96-9c95-c67fdbc3580b" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.484550] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.484658] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.484727] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.484901] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.484982] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.485111] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a33b05-c764-41fc-b486-255a775ecff1" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.637741] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 350c3e5b-5953-4a2c-bcae-93550de23d21: rpc.has_security_group_logging(os_id): False [ 1540.657374] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.657523] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.657593] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.657801] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.677987] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.678324] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.678446] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.678517] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.678726] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.678811] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.678902] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 is going to be updated. [ 1540.748255] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.748558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.748558] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.748701] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.748867] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.761951] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: IN_PROGRESS for 2s [ 1542.778166] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: SUCCESS [ 1542.778488] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.089026] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.089397] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.090743] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1549.091197] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.643062] env[65162]: INFO networking_nsxv3.common.synchronization [req-aeb0ce65-68b3-430e-8d80-a1966e9ae307 req-6016778d-0108-40d3-a828-8b1332ad0bec tempest-AttachVolumeTestJSON-138892547 tempest-AttachVolumeTestJSON-138892547-project-member] Enqueued Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_members [ 1549.643636] env[65162]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 with Priority: HIGHEST for action security_group_members [ 1549.644434] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock member-350c3e5b-5953-4a2c-bcae-93550de23d21 taken with stack trace [, , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.644434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.644434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.644434] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.644712] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.644712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.644712] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.644827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.644827] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.645207] env[65162]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('350c3e5b-5953-4a2c-bcae-93550de23d21',) {} {{(pid=65162) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.149657] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.150076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.150076] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.150168] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.150268] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.150473] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.150573] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.150637] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.150788] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.150865] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.150952] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 is going to be updated. [ 1550.179795] env[65162]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65162) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.180028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.180028] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.180154] env[65162]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.180293] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.189095] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: IN_PROGRESS for 2s [ 1552.200504] env[65162]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 in Status: SUCCESS [ 1552.200876] env[65162]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 350c3e5b-5953-4a2c-bcae-93550de23d21 deletion is rescheduled due to dependency. [ 1552.200876] env[65162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-350c3e5b-5953-4a2c-bcae-93550de23d21" {{(pid=65162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.644301] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.644674] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.646238] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.646711] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1564.647329] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.647761] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.648837] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.649614] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.650762] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.651151] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.652395] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.652698] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.654172] env[65162]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.654593] env[65162]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0